METAQ

February 22, 2017


Tasks of one sort naïvely bundled, wasting a substantial amount of cycles

Tasks of many sorts bundled with METAQ, wasting far fewer cycles.

METAQ is a small suite of bash scripts I wrote to increase the ease and efficiency with which my collaborators and I use supercomputing resources.

Supercomputing time is almost always awarded through a competitive proposal process, and there’s usually not enough to make everybody happy. So, if you receive an allocation, you want to be sure you use it as best you can.

METAQ helps you avoid wasted cycles, by making it simple to group computational tasks together and to slot smaller and shorter tasks into otherwise-wasted cycles.

I wrote up a description of METAQ for the arχiv.

Update 2017-03-21: METAQ was covered by The Next Platform!

February 22, 2017

METAQ - February 22, 2017 - {"name"=>"Evan Berkowitz", "twitter"=>"evanberkowitz", "email"=>"evan@evanberkowitz.com", "phone"=>"+1 917-692-5685", "inspire"=>"http://inspirehep.net/search?ln=en&ln=en&p=find+a+%22Evan+Berkowitz%22+or+a+%22E.+Berkowitz%22+not+%22E.H.+Berkowitz%22&of=hb&action_search=Search&sf=earliestdate&so=d&rm=&rg=25&sc=0", "arxiv"=>"http://arxiv.org/a/berkowitz_e_1", "github"=>"http://github.com/evanberkowitz", "linkedin"=>"https://www.linkedin.com/in/evanberkowitz", "google_scholar"=>"https://scholar.google.com/citations?user=hEy9k60AAAAJ", "orcid"=>"http://orcid.org/0000-0003-1082-1374"}