Releases: PySlurm/pyslurm
Releases · PySlurm/pyslurm
v23.2.3
https://pyslurm.github.io/23.2/changelog/
Added
- Add
truncate_timeoption topyslurm.db.JobFilter, which is the same as -T /
--truncate from sacct. - Add new Attributes to
pyslurm.db.Jobsthat help gathering statistics for a
collection of Jobs more convenient. - Add new
idle_memoryandallocated_tresattributes topyslurm.Nodeclass - Added
statsattribute to bothpyslurm.Job,pyslurm.Jobsand
pyslurm.db.Jobs - Added
pidsattribute topyslurm.Jobwhich contains Process-IDs of the Job
organized by node-name - Added
load_statsmethod topyslurm.Jobandpyslurm.Jobsclasses.
Together with thestatsandpidsattributes mentioned above, it is now
possible to fetch live statistics (like sstat) - Switch to link with
libslurmfull.soinstead oflibslurm.so
This change really has no impact from a user perspective. Everything will
keep working the same, except that Slurms more internal library
libslurmfull.sois linked with (which is located alongside the plugins
inside theslurmdirectory, which itself is next tolibslurm.so)
Why the change? Because it will likely make development easier. It allows
access to more functions that might be needed in some places, without
completely having to implement them on our own. Implementing the
live-statistics feature, so basicallysstat, is for example not possible
withlibslurm.so
You can keep providing the directory wherelibslurm.soresided as
$SLURM_LIB_DIRto pyslurm, and it will automatically findlibslurmfull.so
from there. - Added
run_time_remainingandelapsed_cpu_timeattributes topyslurm.JobStep - Added
run_time_remainingattribute topyslurm.Job
Fixed
- Fix
allocated_gresattribute in thepyslurm.NodeClass returning nothing. - Fix Node State being displayed as
ALLOCATEDwhen it should actually be
MIXED. - Fix crash for the
gres_per_nodeattribute of thepyslurm.Jobclass when
the GRES String received from Slurm contains no count. - Fixed
total_cpu_time,system_cpu_timeanduser_cpu_timenot getting
calculated correctly for Job statistics - Actually make sure that
avg_cpu_time,min_cpu_time,total_cpu_time,
system_cpu_timeanduser_cpu_timeare integers, not float.
Changed
- Breaking: rename
cpu_timetoelapsed_cpu_timeinpyslurm.Joband
pyslurm.Jobsclasses - Breaking: rename attribute
alloc_cpusto justcpusinpyslurm.JobStep - Breaking: removed the following attributes from
pyslurm.db.Jobs:
consumed_energydisk_readdisk_writepage_faultsresident_memoryvirtual_memoryelapsed_cpu_timetotal_cpu_timeuser_cpu_timesystem_cpu_time
- The removed attributes above are now all available within the
stats
attribute, which is of typepyslurm.db.JobStatistics - Renamed the original class of
pyslurm.db.JobStatisticsto
pyslurm.db.JobStepStatistics.
All this class contains is really mostly applicable only to Steps, but
doesn't fully apply at the Job Level.
Therefore, the newpyslurm.db.JobStatisticsclass only contains all
statistics that make sense at the Job-level. - return
1as a value for thecpusattribute inpyslurm.db.Jobwhen there
is no value set from Slurm's side.
Removed
- Removed
pyslurm.version()function. Should use__version__attribute directly. - Removed
--slurm-liband--slurm-incparameters tosetup.py.
SLURM_LIB_DIRandSLURM_INCLUDE_DIRenvironment variables should be used instead.
v24.11.0
v23.11.1
Added
- Added
statsattribute to bothpyslurm.Job,pyslurm.Jobsand
pyslurm.db.Jobs - Added
pidsattribute topyslurm.Jobwhich contains Process-IDs of the Job
organized by node-name - Added
load_statsmethod topyslurm.Jobandpyslurm.Jobsclasses.
Together with thestatsandpidsattributes mentioned above, it is now
possible to fetch live statistics (like sstat) - Switch to link with
libslurmfull.soinstead oflibslurm.so
This change really has no impact from a user perspective. Everything will
keep working the same, except that Slurms more internal library
libslurmfull.sois linked with (which is located alongside the plugins
inside theslurmdirectory, which itself is next tolibslurm.so)
Why the change? Because it will likely make development easier. It allows
access to more functions that might be needed in some places, without
completely having to implement them on our own. Implementing the
live-statistics feature, so basicallysstat, is for example not possible
withlibslurm.so
You can keep providing the directory wherelibslurm.soresided as
$SLURM_LIB_DIRto pyslurm, and it will automatically findlibslurmfull.so
from there. - Added
run_time_remainingandelapsed_cpu_timeattributes topyslurm.JobStep - Added
run_time_remainingattribute topyslurm.Job
Fixed
- Fixed
total_cpu_time,system_cpu_timeanduser_cpu_timenot getting
calculated correctly for Job statistics - Actually make sure that
avg_cpu_time,min_cpu_time,total_cpu_time,
system_cpu_timeanduser_cpu_timeare integers, not float.
Changed
- Breaking: rename
cpu_timetoelapsed_cpu_timeinpyslurm.Joband
pyslurm.Jobsclasses - Breaking: rename attribute
alloc_cpusto justcpusinpyslurm.JobStep - Breaking: removed the following attributes from
pyslurm.db.Jobs:
consumed_energydisk_readdisk_writepage_faultsresident_memoryvirtual_memoryelapsed_cpu_timetotal_cpu_timeuser_cpu_timesystem_cpu_time
- The removed attributes above are now all available within the
stats
attribute, which is of typepyslurm.db.JobStatistics - Renamed the original class of
pyslurm.db.JobStatisticsto
pyslurm.db.JobStepStatistics.
All this class contains is really mostly applicable only to Steps, but
doesn't fully apply at the Job Level.
Therefore, the newpyslurm.db.JobStatisticsclass only contains all
statistics that make sense at the Job-level. - return
1as a value for thecpusattribute inpyslurm.db.Jobwhen there
is no value set from Slurm's side.
Removed
- Removed
pyslurm.version()function. Should use__version__attribute directly. - Removed
--slurm-liband--slurm-incparameters tosetup.py.
SLURM_LIB_DIRandSLURM_INCLUDE_DIRenvironment variables should be used instead.
v24.5.1
Added
- Added
statsattribute to bothpyslurm.Job,pyslurm.Jobsand
pyslurm.db.Jobs - Added
pidsattribute topyslurm.Jobwhich contains Process-IDs of the Job
organized by node-name - Added
load_statsmethod topyslurm.Jobandpyslurm.Jobsclasses.
Together with thestatsandpidsattributes mentioned above, it is now
possible to fetch live statistics (like sstat) - Switch to link with
libslurmfull.soinstead oflibslurm.so
This change really has no impact from a user perspective. Everything will
keep working the same, except that Slurms more internal library
libslurmfull.sois linked with (which is located alongside the plugins
inside theslurmdirectory, which itself is next tolibslurm.so)
Why the change? Because it will likely make development easier. It allows
access to more functions that might be needed in some places, without
completely having to implement them on our own. Implementing the
live-statistics feature, so basicallysstat, is for example not possible
withlibslurm.so
You can keep providing the directory wherelibslurm.soresided as
$SLURM_LIB_DIRto pyslurm, and it will automatically findlibslurmfull.so
from there. - Added
run_time_remainingandelapsed_cpu_timeattributes topyslurm.JobStep - Added
run_time_remainingattribute topyslurm.Job
Fixed
- Fixed
total_cpu_time,system_cpu_timeanduser_cpu_timenot getting
calculated correctly for Job statistics - Actually make sure that
avg_cpu_time,min_cpu_time,total_cpu_time,
system_cpu_timeanduser_cpu_timeare integers, not float.
Changed
- Breaking: rename
cpu_timetoelapsed_cpu_timeinpyslurm.Joband
pyslurm.Jobsclasses - Breaking: rename attribute
alloc_cpusto justcpusinpyslurm.JobStep - Breaking: removed the following attributes from
pyslurm.db.Jobs:
consumed_energydisk_readdisk_writepage_faultsresident_memoryvirtual_memoryelapsed_cpu_timetotal_cpu_timeuser_cpu_timesystem_cpu_time
- The removed attributes above are now all available within the
stats
attribute, which is of typepyslurm.db.JobStatistics - Renamed the original class of
pyslurm.db.JobStatisticsto
pyslurm.db.JobStepStatistics.
All this class contains is really mostly applicable only to Steps, but
doesn't fully apply at the Job Level.
Therefore, the newpyslurm.db.JobStatisticsclass only contains all
statistics that make sense at the Job-level. - return
1as a value for thecpusattribute inpyslurm.db.Jobwhen there
is no value set from Slurm's side.
Removed
- Removed
pyslurm.version()function. Should use__version__attribute directly. - Removed
--slurm-liband--slurm-incparameters tosetup.py.
SLURM_LIB_DIRandSLURM_INCLUDE_DIRenvironment variables should be used instead.
v24.5.0
v23.11.0
Added
- Support for Slurm 23.11.x
- Add
truncate_timeoption topyslurm.db.JobFilter, which is the same as -T /
--truncate from sacct. - Add new attributes to
pyslurm.db.Jobsthat help gathering statistics for a
collection of Jobs more convenient. - Add new attribute
gres_tasks_per_sharingtopyslurm.Joband
pyslurm.JobSubmitDescription
Fixed
- Fix
allocated_gresattribute in thepyslurm.NodeClass returning nothing. - Add new
idle_memoryandallocated_tresattributes topyslurm.Nodeclass - Fix Node State being displayed as
ALLOCATEDwhen it should actually be
MIXED. - Fix crash for the
gres_per_nodeattribute of thepyslurm.Jobclass when
the GRES String received from Slurm contains no count.
Removed
route_plugin,job_credential_private_keyandjob_credential_public_certificate
keys are removed from the output ofpyslurm.config().get()- Some deprecated and unused Slurm constants