Changelog¶
All notable user-facing changes to dagster-ray
will be documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
0.3.0¶
This release includes massive docs improvements and drops support for Python 3.9
Changes¶
- [
breaking] dropped Python 3.9 support (EOL October 2025)
- [internal] most of the general, backend-agnostic code has been moved to
dagster_ray.core
(top-level imports still work)
0.2.1¶
Fixes¶
- Fixed broken wheel on PyPI
0.2.0¶
Changed¶
KubeRayInteractiveJob.deletion_strategy
now defaults toDeleteCluster
for both successful and failed executions. This is a reasonable default for the use case.KubeRayInteractiveJob.ttl_seconds_after_finished
now defaults to600
seconds.KubeRayCluster.lifecycle.cleanup
now defaults toalways
- [
breaking]
RayJob
andRayCluster
clients and resources Kubernetes init parameters have been renamed tokube_config
andkube_context
.
Added¶
- new
enable_legacy_debugger
configuration parameter to subclasses ofRayResource
- new
on_exception
option forlifecycle.cleanup
policy. It's triggered during resource setup/cleanup (includingKeyboardInterrupt
), but not by user@op
/@asset
code. KubeRayInteractiveJob
now respectslifecycle.cleanup
. It defaults toon_exception
. Users are advised to rely on built-inRayJob
cleanup mechanisms, such asttlSecondsAfterFinished
anddeletionStrategy
.
Fixes¶
- removed
ignore_reinit_error
fromRayResource
init options: it's potentially dangerous, for example in case the user has accidentally connected to another Ray cluster (including local ray) before initializing the resource.
0.1.0¶
Changed¶
- [
breaking]
RayResource
: top-levelskip_init
andskip_setup
configuration parameters have been removed. Thelifecycle
field is the new way of configuring steps performed during resource initialization.KubeRayCluster
'sskip_cleanup
has been moved tolifecycle
as well. - [
breaking] injected
dagster.io/run_id
Kubernetes label has been renamed todagster/run-id
. Keys starting withdagster.io/
have been converted todagster/
to match howdagster-k8s
does it. - [
breaking]
dagster_ray.kuberay
Configurations have been unified with KubeRay APIs. dagster-ray
now populates Kubernetes labels with more values (including some useful Dagster Cloud values such asgit-sha
)
Added¶
KubeRayInteractiveJob
-- a new resource that utililizes the newInteractiveMode
forRayJob
. It can be used to connect to Ray in Client mode -- likeKubeRayCluster
-- but gives access toRayJob
features, such as automatic cleanup (ttlSecondsAfterFinished
), retries (backoffLimit
) and timeouts (activeDeadlineSeconds
).RayResource
setup lifecycle has been overhauled: resources now has anactions
parameter with 3 configuration options:create
,wait
andconnect
. The user can disable them and run.create()
,.wait()
and.connect()
manually if needed.