← 输入框|github.com|刷新
Skip to content

Allow the collection of job run information - #139

Merged
d-j-hatton merged 4 commits into
mainfrom
parse-logs
Mar 8, 2022
Merged

d-j-hatton merged 4 commits into
mainfrom
parse-logs

Conversation

@d-j-hatton

Copy link
Copy Markdown
Contributor

Setting cluster=True in the initialisation of a Project will collect some job run information such as cluster IDs, cluster job start times and the number of micrographs processed by a particular job from log and output files. It is assumed that the submission script used by Relion will write a line before running the job command in the format:

$(date '+%Y-%m-%d %H:%M:%S.%3N'): running RELION job on host $(hostname -s) with job ID ${JOB_ID:-(JOB_ID not set)}

Nothing is done with this information in this PR but it partially addresses #136

Done within a thread pool to try and speed up the IO
…eline has been stopped and abort files written, but the job was still successful and run information can be collected
@codecov

codecov Bot commented Nov 10, 2021 •

Copy link
Copy Markdown

Codecov Report

Merging #139 (4184676) into main (5988f30) will increase coverage by 0.33%.
The diff coverage is 72.82%.

❗ Current head 4184676 differs from pull request most recent head e239c04. Consider uploading reports for the commit e239c04 to get more accurate results

@@            Coverage Diff             @@
##             main     #139      +/-   ##
==========================================
+ Coverage   49.70%   50.04%   +0.33%     
==========================================
  Files          38       38              
  Lines        4734     4820      +86     
  Branches      842      863      +21     
==========================================
+ Hits         2353     2412      +59     
- Misses       2232     2253      +21     
- Partials      149      155       +6     

@d-j-hatton
d-j-hatton merged commit fc56bd0 into main Mar 8, 2022
@d-j-hatton
d-j-hatton deleted the parse-logs branch March 8, 2022 10:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant