Skip to content

Conversation

@LanderOtto
Copy link
Collaborator

@LanderOtto LanderOtto commented Mar 25, 2024

This commit changes the Policy interface to take in input batch of jobs. Prior this commit, it was passed one job at time. Instead, a global vision of all the pending jobs allows to implement more sophisticated scheduling strategies.
This change involves the entire Scheduler class.

Comment on lines 308 to 252
# for path, size in deployment_hw.storage.items():
# # todo: it is not really correct. They can have the same starts but be in different volumes
# # e.g. / -> volume1 and /mnt/data -> volume2
# if job.tmp_directory.startswith(path):
# size -= hw_requirement.tmp_dir_size
# elif job.output_directory.startswith(path):
# size -= hw_requirement.output_dir_size
# storage[path] = size

Check notice

Code scanning / CodeQL

Commented-out code

This comment appears to contain commented-out code.
@codecov
Copy link

codecov bot commented Mar 26, 2024

Codecov Report

Attention: Patch coverage is 92.52874% with 13 lines in your changes are missing coverage. Please review.

Project coverage is 70.32%. Comparing base (c36df55) to head (a6c78da).
Report is 2 commits behind head on master.

Files Patch % Lines
streamflow/scheduling/scheduler.py 89.09% 3 Missing and 3 partials ⚠️
streamflow/scheduling/policy/data_locality.py 93.02% 1 Missing and 2 partials ⚠️
streamflow/deployment/connector/local.py 84.61% 1 Missing and 1 partial ⚠️
streamflow/deployment/connector/ssh.py 87.50% 1 Missing and 1 partial ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master     #418      +/-   ##
==========================================
+ Coverage   69.99%   70.32%   +0.33%     
==========================================
  Files          83       83              
  Lines       10591    10601      +10     
  Branches     2505     2490      -15     
==========================================
+ Hits         7413     7455      +42     
+ Misses       2728     2700      -28     
+ Partials      450      446       -4     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@GlassOfWhiskey GlassOfWhiskey force-pushed the master branch 2 times, most recently from 9660fdc to 90a078e Compare December 13, 2024 12:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants