Yeedu (1.0.0)
Download OpenAPI specification:Download
This is a server for Yeedu.
Get all the cloud providers.
Retrieves a list of cloud providers supported by the system.
Authorizations:
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "cloud_provider_id": "0",
- "name": "GCP",
- "description": "Provider for creating infrastructure on Google Cloud Platform",
- "from_date": "2024-06-20T14:08:12.294Z",
- "to_date": null
}, - {
- "cloud_provider_id": "1",
- "name": "AWS",
- "description": "Provider for creating infrastructure on Amazon Web Services",
- "from_date": "2024-06-20T14:08:12.294Z",
- "to_date": null
}, - {
- "cloud_provider_id": "2",
- "name": "Azure",
- "description": "Provider for creating infrastructure on Azure Cloud Platform",
- "from_date": "2024-06-20T14:08:12.294Z",
- "to_date": null
}
]
Get details about a specific cloud provider.
Retrieve details about a specific cloud provider identified by the provided Cloud Provider Id.
Authorizations:
path Parameters
cloud_provider_id required | integer <int64> Cloud provider Id used for filtering |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "cloud_provider_id": "0",
- "name": "GCP",
- "description": "Provider for creating infrastructure on Google Cloud Platform",
- "from_date": "2024-06-20T14:08:12.294Z",
- "to_date": null
}
Get all the disk machine types.
Retrieves a list of supported disk machine types.
Authorizations:
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "disk_type_id": "0",
- "cloud_provider": {
- "name": "GCP",
- "description": "Provider for creating infrastructure on Google Cloud Platform"
}, - "name": "pd-ssd",
- "has_fixed_size": false,
- "min_size": 10,
- "max_size": 64000,
- "from_date": "2024-06-20T14:08:12.294Z",
- "to_date": null
}
]
Get all the machine available zones.
Retrieves a list of available zones across all cloud providers.
Authorizations:
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "availability_zone_id": 175,
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure",
- "description": "Provider for creating infrastructure on Azure Cloud Platform"
}, - "name": "South Africa West",
- "region": "South Africa West",
- "description": "Africa",
- "from_date": "2024-06-20T14:08:12.310386+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 176,
- "total_pages": 176,
- "limit": 1,
- "next_page": 2
}
}
Get machine availability zones for a specific cloud provider.
Retrieves details of machine availability zones filtered by a specific Cloud Provider Id.
Authorizations:
path Parameters
cloud_provider_id required | integer <int64> Cloud Provider Id used for filtering. |
query Parameters
all | boolean Default: false Enum: true false A boolean that can be set to return all the data. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "availability_zone_id": 175,
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure",
- "description": "Provider for creating infrastructure on Azure Cloud Platform"
}, - "name": "South Africa West",
- "region": "South Africa West",
- "description": "Africa",
- "from_date": "2024-06-20T14:08:12.310386+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 176,
- "total_pages": 176,
- "limit": 1,
- "next_page": 2
}
}
Get machine availability zone details by a specific cloud provider ID and availability zone ID
Retrieve machine availability zone details based on a specific cloud provider and availability zone ID.
Authorizations:
path Parameters
cloud_provider_id required | integer <int64> Cloud provider Id used for filtering. |
availability_zone_id required | integer <int64> Availability zone Id used for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "availability_zone_id": "108",
- "cloud_provider": {
- "name": "AWS",
- "description": "Provider for creating infrastructure on Amazon Web Services"
}, - "name": "ap-east-1",
- "region": "ap-east-1",
- "description": "Hong Kong, Asia Pacific",
- "from_date": "2024-06-20T14:08:12.310Z",
- "to_date": null
}
Get all the machine types.
Retrieves a list of supported machine types.
Authorizations:
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "machine_type_id": 241,
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure",
- "description": "Provider for creating infrastructure on Azure Cloud Platform"
}, - "name": "Standard_NV72ads_A10_v5",
- "vCPUs": 72,
- "memory": "880 GiB",
- "has_cuda": true,
- "gpu_model": "NVIDIA A10",
- "gpus": 2,
- "gpu_memory": "48 GB",
- "cpu_model": [
- "AMD EPYC 74F3V(Milan)"
], - "cpu_min_frequency_GHz": [
- "3.2"
], - "cpu_max_frequency_GHz": [
- "4"
], - "has_local_disk": true,
- "local_disk_size_GB": 1400,
- "local_num_of_disks": 1,
- "local_disk_bus_type": {
- "local_disk_bus_type_id": 0,
- "local_disk_bus_type": "SCSI"
}, - "local_disk_throughput_MB": null,
- "machine_price_ycu": 106,
- "from_date": "2024-06-20T14:08:12.30262+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 241,
- "total_pages": 241,
- "limit": 1,
- "next_page": 2
}
}
Get all the machine types for a specific cloud provider.
Retrieve details of machine types filtered by a specific cloud provider.
Authorizations:
path Parameters
cloud_provider_id required | integer <int64> Cloud Provider Id used for filtering. |
query Parameters
all | boolean Default: false Enum: true false A boolean that can be set to return all the data. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "machine_type_id": 241,
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure",
- "description": "Provider for creating infrastructure on Azure Cloud Platform"
}, - "name": "Standard_NV72ads_A10_v5",
- "vCPUs": 72,
- "memory": "880 GiB",
- "has_cuda": true,
- "gpu_model": "NVIDIA A10",
- "gpus": 2,
- "gpu_memory": "48 GB",
- "cpu_model": [
- "AMD EPYC 74F3V(Milan)"
], - "cpu_min_frequency_GHz": [
- "3.2"
], - "cpu_max_frequency_GHz": [
- "4"
], - "has_local_disk": true,
- "local_disk_size_GB": 1400,
- "local_num_of_disks": 1,
- "local_disk_bus_type": {
- "local_disk_bus_type_id": 0,
- "local_disk_bus_type": "SCSI"
}, - "local_disk_throughput_MB": null,
- "machine_price_ycu": 106,
- "from_date": "2024-06-20T14:08:12.30262+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 241,
- "total_pages": 241,
- "limit": 1,
- "next_page": 2
}
}
Get machine type details for a specific cloud provider and machine type.
Retrieve details of a machine type filtered by a specific Cloud Provider Id and Machine Type Id.
Authorizations:
path Parameters
cloud_provider_id required | integer <int64> Cloud Provider Id used for filtering. |
machine_type_id required | integer <int64> Machine Type Id used for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "machine_type_id": 108,
- "cloud_provider": {
- "cloud_provider_id": 1,
- "name": "AWS",
- "description": "Provider for creating infrastructure on Amazon Web Services"
}, - "name": "m6id.4xlarge",
- "vCPUs": 16,
- "memory": "64 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon 8375C"
], - "cpu_min_frequency_GHz": [
- "2.9"
], - "cpu_max_frequency_GHz": [
- "3.5"
], - "has_local_disk": true,
- "local_disk_size_GB": 950,
- "local_num_of_disks": 1,
- "local_disk_bus_type": {
- "local_disk_bus_type_id": 1,
- "local_disk_bus_type": "NVME"
}, - "local_disk_throughput_MB": null,
- "machine_price_ycu": 10.4,
- "from_date": "2024-06-20T14:08:12.30262+00:00",
- "to_date": "infinity"
}
Get all the credential types.
Retrieves a list of credential types supported by the system.
Authorizations:
query Parameters
cloud_provider | string Enum: "GCP" "AWS" "Azure" Cloud provider used for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "credential_type_id": 0,
- "name": "Google Service Account",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP",
- "description": "Provider for creating infrastructure on Google Cloud Platform"
}, - "from_date": "2024-06-20T14:08:12.297945+00:00",
- "to_date": "infinity"
}, - {
- "credential_type_id": 1,
- "name": "AWS Access Secret Key Pair",
- "cloud_provider": {
- "cloud_provider_id": 1,
- "name": "AWS",
- "description": "Provider for creating infrastructure on Amazon Web Services"
}, - "from_date": "2024-06-20T14:08:12.297945+00:00",
- "to_date": "infinity"
}, - {
- "credential_type_id": 2,
- "name": "Azure Service Principal",
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure",
- "description": "Provider for creating infrastructure on Azure Cloud Platform"
}, - "from_date": "2024-06-20T14:08:12.297945+00:00",
- "to_date": "infinity"
}
]
Get all the cluster types.
Retrieves a list of cluster types supported by the system.
Authorizations:
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "cluster_type_id": "0",
- "name": "YEEDU",
- "description": "Yeedu Mode",
- "from_date": "2024-06-20T14:08:12.297Z",
- "to_date": null
}, - {
- "cluster_type_id": "1",
- "name": "STANDALONE",
- "description": "Spark Cluster Single Machine",
- "from_date": "2024-06-20T14:08:12.297Z",
- "to_date": null
}, - {
- "cluster_type_id": "2",
- "name": "CLUSTER",
- "description": "Spark Cluster Multiple Machines",
- "from_date": "2024-06-20T14:08:12.297Z",
- "to_date": null
}
]
Get all the engine cluster instance statuses.
Retrieves a list of engine cluster instance statuses defined by the system.
Authorizations:
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "engine_cluster_instance_status_id": "1",
- "name": "RUNNING",
- "description": "Cluster was created and its running",
- "from_date": "2024-06-20T14:08:12.296Z",
- "to_date": null
}
]
Get all the Spark compute types.
Retrieves a list of Spark compute types defined by the system.
Authorizations:
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "spark_compute_type_id": "0",
- "name": "YEEDU",
- "description": null,
- "from_date": "2024-06-20T14:08:12.314Z",
- "to_date": null
}
]
Get all the Spark infrastructure versions.
Retrieves a list of Spark infrastructure versions supported by the system.
Authorizations:
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "spark_infra_version_id": "2",
- "spark_docker_image_name": "v3.3.4-3",
- "spark_version": "3.3.4",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": false,
- "from_date": "2024-06-20T14:08:12.300Z",
- "to_date": null
}
]
Get all the Spark job statuses.
Retrieves a list of Spark job statuses defined by the system.
Authorizations:
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "spark_job_status_id": "0",
- "name": "SUBMITTED",
- "description": "Job was submitted, waiting for Application ID",
- "from_date": "2024-03-07T04:55:42.780Z",
- "to_date": null
}
]
Get all the Spark job types.
Retrieves a list of Spark job types supported by the system.
Authorizations:
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "spark_job_type_id": 0,
- "name": "SPARK_JOB",
- "from_date": "2024-03-07T04:55:42.782Z",
- "to_date": null
}, - {
- "spark_job_type_id": 1,
- "name": "NOTEBOOK",
- "from_date": "2024-03-07T04:55:42.782Z",
- "to_date": null
}, - {
- "spark_job_type_id": 2,
- "name": "SPARK_SQL",
- "from_date": "2024-03-07T04:55:42.782Z",
- "to_date": null
}
]
Get all the Spark job type languages.
Retrieves a list of Spark job type languages supported by the system.
Authorizations:
query Parameters
spark_job_type_id | integer <int64> Spark job type Id used for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "spark_job_type_lang_id": 0,
- "spark_job_type": {
- "spark_job_type_id": 0,
- "name": "SPARK_JOB"
}, - "lang_name": "RAW_SCALA",
- "from_date": "2024-03-07T04:55:42.783139+00:00",
- "to_date": "infinity"
}
]
Get all the workflow execution states.
Retrieves a list of workflow execution states defined by the system.
Authorizations:
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "workflow_execution_state_id": -1,
- "name": "NONE",
- "description": "NONE",
- "from_date": "2024-03-07T04:55:42.777Z",
- "to_date": null
}
]
Get all the workflow types.
Retrieves a list of workflow types defined by the system.
Authorizations:
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "workflow_type_id": "0",
- "name": "spark_start",
- "queue_name": "yeedu.workflows.usi.start",
- "description": null,
- "from_date": "2024-03-07T04:55:42.778Z",
- "to_date": null
}
]
Get all the Linux distros.
Retrieves a list of Linux distributions supported by the system.
Authorizations:
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "linux_distro_id": "1",
- "distro_name": "UBUNTU",
- "distro_version": "22.04 LTS",
- "from_date": "2024-05-28T14:47:09.860Z",
- "to_date": null
}
]
Get all the machine volume configurations.
Retrieves a list of machine volume configurations.
Authorizations:
query Parameters
cloud_provider | string Enum: "GCP" "AWS" "Azure" Cloud provider used for filtering. |
all | boolean Default: false Enum: true false A boolean that can be set to return all the data. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "volume_conf_id": 24,
- "name": "volume_azure_4",
- "description": null,
- "encrypted": true,
- "size": 2000,
- "disk_type": {
- "disk_type_id": 7,
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure"
}, - "name": "StandardSSD_LRS",
- "has_fixed_size": false,
- "min_size": 4,
- "max_size": 32767
}, - "machine_volume_num": 2,
- "machine_volume_strip_num": 1,
- "disk_iops": null,
- "disk_throughput_MB": null,
- "created_by": null,
- "modified_by": null,
- "last_update_date": "2024-06-25T14:54:39.980421+00:00",
- "from_date": "2024-06-25T14:54:39.980421+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 24,
- "total_pages": 24,
- "limit": 1,
- "next_page": 2
}
}
Search machine volume configurations based on volume configuration name.
Retrieves a list of searched machine volume configurations based on volume configuration name.
Authorizations:
query Parameters
volume_conf_name required | string Volume configuration name used for filtering. |
cloud_provider | string Enum: "GCP" "AWS" "Azure" Cloud provider used for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "volume_conf_id": 24,
- "name": "volume_azure_4",
- "description": null,
- "encrypted": true,
- "size": 2000,
- "disk_type": {
- "disk_type_id": 7,
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure"
}, - "name": "StandardSSD_LRS",
- "has_fixed_size": false,
- "min_size": 4,
- "max_size": 32767
}, - "machine_volume_num": 2,
- "machine_volume_strip_num": 1,
- "disk_iops": null,
- "disk_throughput_MB": null,
- "created_by": null,
- "modified_by": null,
- "last_update_date": "2024-06-25T14:54:39.980421+00:00",
- "from_date": "2024-06-25T14:54:39.980421+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 24,
- "total_pages": 24,
- "limit": 1,
- "next_page": 2
}
}
Create a new volume configuration.
Creates a new volume with the provided volume configuration.
Authorizations:
Request Body schema: application/jsonrequired
The volume configuration to be added.
name required | string non-empty The
|
description | string or null non-empty |
encrypted required | boolean |
size | integer <int64> |
disk_type_id required | integer <int64> |
machine_volume_num required | integer <int64> >= 1 |
machine_volume_strip_num required | integer <int64> >= 1 |
disk_iops | integer <int64> |
disk_throughput_MB | integer <int64> |
Responses
Request samples
- Payload
{- "name": "yeedu_volume",
- "description": "dev volume",
- "encrypted": true,
- "size": 100,
- "disk_type_id": 0,
- "machine_volume_num": 1,
- "machine_volume_strip_num": 1
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "volume_conf_id": "25",
- "name": "yeedu_volume",
- "description": "dev volume",
- "encrypted": true,
- "size": "100",
- "disk_type_id": "0",
- "disk_type_name": "pd-ssd",
- "machine_volume_num": 1,
- "machine_volume_strip_num": 1,
- "disk_iops": null,
- "disk_throughput_MB": null,
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-03-08T05:34:55.306Z",
- "from_date": "2024-03-08T05:34:55.306Z",
- "to_date": null
}
Get details of a specific volume configuration.
Retrieve volume configuration details filtered by volume configuration ID or name.
Authorizations:
query Parameters
volume_conf_id | integer <int64> Volume configuration ID used for filtering. |
volume_conf_name | string Volume configuration name used for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "volume_conf_id": 18,
- "volume_conf_name": "volume_aws_2",
- "description": null,
- "encrypted": true,
- "size": 500,
- "disk_type": {
- "disk_type_id": 3,
- "cloud_provider": {
- "cloud_provider_id": 1,
- "name": "AWS"
}, - "name": "gp2",
- "has_fixed_size": false,
- "min_size": 1,
- "max_size": 16000
}, - "machine_volume_num": 1,
- "machine_volume_strip_num": 1,
- "disk_iops": null,
- "disk_throughput_MB": null,
- "created_by": null,
- "modified_by": null,
- "last_update_date": "2024-06-25T14:54:39.980421+00:00",
- "from_date": "2024-06-25T14:54:39.980421+00:00",
- "to_date": "infinity"
}
Update details of a specific volume configuration.
Authorizations:
query Parameters
volume_conf_id | integer <int64> Volume configuration ID used for modification. |
volume_conf_name | string Volume configuration name used for modification. |
Request Body schema: application/jsonrequired
The volume configuration to be modified.
name | string non-empty The
|
description | string or null non-empty |
encrypted | boolean |
machine_volume_num | integer <int64> |
machine_volume_strip_num | integer <int64> |
size | integer <int64> |
disk_type_id | integer <int64> |
disk_iops | integer or null <int64> |
disk_throughput_MB | integer or null <int64> |
Responses
Request samples
- Payload
{- "name": "yeedu_volume",
- "description": "dev volume",
- "encrypted": true,
- "machine_volume_num": 1,
- "machine_volume_strip_num": 1,
- "size": 100,
- "disk_type_id": 0
}
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "volume_conf_id": "25",
- "name": "yeedu_volume",
- "description": "dev volume",
- "encrypted": true,
- "size": "100",
- "disk_type_id": "0",
- "disk_type_name": "pd-ssd",
- "machine_volume_num": 1,
- "machine_volume_strip_num": 1,
- "disk_iops": null,
- "disk_throughput_MB": null,
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-03-08T05:34:55.306Z",
- "from_date": "2024-03-08T05:34:55.306Z",
- "to_date": null
}
Delete a specific volume configuration.
Authorizations:
query Parameters
volume_conf_id | integer <int64> Volume configuration ID used for deletion. |
volume_conf_name | string Volume configuration name used for deletion. |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "Deleted machine volume configuration ID: 1."
}
Get all the machine network configurations.
Retrieves a list of machine network configurations.
Authorizations:
query Parameters
cloud_provider | string Enum: "GCP" "AWS" "Azure" Cloud provider used for filtering. |
all | boolean Default: false Enum: true false A boolean that can be set to return all the data. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "network_conf_id": 7,
- "network_conf_name": "azure_network",
- "description": null,
- "network_project_id": "yeedu-project",
- "network_name": "yeedu-network",
- "network_tags": [
- "yeedu",
- "iap-allow"
], - "subnet": "yeedu-subnet",
- "availability_zone": {
- "availability_zone_id": 129,
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure",
- "description": "Provider for creating infrastructure on Azure Cloud Platform"
}, - "name": "East US",
- "region": "East US",
- "description": "US, North America"
}, - "tenant_id": "ec234745-4625-4abc-9ae7-1f8a9a9090b3",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-06-27T06:16:43.073805+00:00",
- "from_date": "2024-06-27T06:16:43.073805+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 3,
- "total_pages": 3,
- "limit": 1,
- "next_page": 2
}
}
Search machine network configurations based on network configuration name.
Retrieves a list of searched machine network configurations based on network configuration name.
Authorizations:
query Parameters
network_conf_name required | string Network configuration name used for filtering. |
cloud_provider | string Enum: "GCP" "AWS" "Azure" Cloud provider used for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "network_conf_id": 7,
- "network_conf_name": "azure_network",
- "description": null,
- "network_project_id": "yeedu-project",
- "network_name": "yeedu-network",
- "network_tags": [
- "yeedu",
- "iap-allow"
], - "subnet": "yeedu-subnet",
- "availability_zone": {
- "availability_zone_id": 129,
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure",
- "description": "Provider for creating infrastructure on Azure Cloud Platform"
}, - "name": "East US",
- "region": "East US",
- "description": "US, North America"
}, - "tenant_id": "ec234745-4625-4abc-9ae7-1f8a9a9090b3",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-06-27T06:16:43.073805+00:00",
- "from_date": "2024-06-27T06:16:43.073805+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 3,
- "total_pages": 3,
- "limit": 1,
- "next_page": 2
}
}
Create a new network configuration.
Creates a new network with the provided network configuration.
Authorizations:
Request Body schema: application/jsonrequired
The network configuration to be added.
name required | string non-empty The
|
description | string or null non-empty |
network_project_id required | string non-empty |
network_name required | string non-empty |
network_tags | Array of strings unique [ items non-empty ] |
subnet required | string non-empty |
availability_zone_id required | integer <int64> |
Responses
Request samples
- Payload
{- "name": "yeedu_network",
- "description": "Yeedu machine network config.",
- "network_project_id": "yeedu",
- "network_name": "yeedu-spark-vpc",
- "network_tags": [
- "yeedu",
- "iap-allow"
], - "subnet": "custom-subnet-yeedu",
- "availability_zone_id": 75
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "network_conf_id": "1",
- "name": "yeedu_network",
- "description": "Yeedu machine network config.",
- "network_project_id": "yeedu",
- "network_name": "yeedu-spark-vpc",
- "network_tags": [
- "yeedu",
- "iap-allow"
], - "subnet": "custom-subnet-yeedu",
- "availability_zone_id": "75",
- "tenant_id": "eeaf2b29-d2b0-4c32-8d74-4c9b565ce8bd",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-03-08T13:45:11.117224+00:00",
- "from_date": "2024-03-08T13:45:11.117224+00:00",
- "to_date": null
}
Get details of a specific network configuration.
Retrieve network configuration details filtered by network configuration ID or name.
Authorizations:
query Parameters
network_conf_id | integer <int64> Network configuration ID used for filtering. |
network_conf_name | string Network configuration name used for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "network_conf_id": 1,
- "network_conf_name": "aws_network",
- "description": null,
- "network_project_id": "1234-4569-8765",
- "network_name": "eni-0123d56edd7c8fe9f",
- "network_tags": [
- "sg-0ac12ceaffcd345fa"
], - "subnet": "subnet-0d12345a67890d12d",
- "availability_zone": {
- "availability_zone_id": 103,
- "cloud_provider": {
- "cloud_provider_id": 1,
- "name": "AWS",
- "description": "Provider for creating infrastructure on Amazon Web Services"
}, - "name": "us-east-2",
- "region": "us-east-2",
- "description": "Ohio, US East"
}, - "tenant_id": "ec234745-4625-4abc-9ae7-1f8a9a9090b3",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-06-26T04:55:34.255071+00:00",
- "from_date": "2024-06-26T04:55:34.255071+00:00",
- "to_date": "infinity"
}
Update details of a specific network configuration.
Authorizations:
query Parameters
network_conf_id | integer <int64> Network configuration ID used for modification. |
network_conf_name | string Network configuration name used for modification. |
Request Body schema: application/jsonrequired
The network configuration to be modified.
name | string non-empty The
|
description | string or null non-empty |
network_project_id | string non-empty |
network_name | string non-empty |
network_tags | Array of strings unique [ items non-empty ] |
subnet | string non-empty |
availability_zone_id | integer <int64> |
Responses
Request samples
- Payload
{- "name": "yeedu_network",
- "description": "Yeedu machine network config.",
- "network_project_id": "yeedu",
- "network_name": "yeedu-spark-vpc",
- "network_tags": [
- "yeedu",
- "iap-allow"
], - "subnet": "custom-subnet-yeedu",
- "availability_zone_id": 75
}
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "network_conf_id": "1",
- "name": "yeedu_network",
- "description": "Yeedu machine network config.",
- "network_project_id": "yeedu",
- "network_name": "yeedu-spark-vpc",
- "network_tags": [
- "yeedu",
- "iap-allow"
], - "subnet": "custom-subnet-yeedu",
- "availability_zone_id": "75",
- "tenant_id": "eeaf2b29-d2b0-4c32-8d74-4c9b565ce8bd",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-03-08T13:45:11.117224+00:00",
- "from_date": "2024-03-08T13:45:11.117224+00:00",
- "to_date": null
}
Delete a specific network configuration.
Authorizations:
query Parameters
network_conf_id | integer <int64> Network configuration ID used for deletion. |
network_conf_name | string Network configuration name used for deletion. |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "Deleted machine network configuration ID: 1."
}
Get all the boot disk image configurations.
Retrieves a list of boot disk image configurations.
Authorizations:
query Parameters
cloud_provider | string Enum: "GCP" "AWS" "Azure" Cloud provider used for filtering. |
all | boolean Default: false Enum: true false A boolean that can be set to return all the data. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "boot_disk_image_id": 5,
- "boot_disk_image_name": "azure_rhel",
- "description": "Base image for Azure RHEL",
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure",
- "description": "Provider for creating infrastructure on Azure Cloud Platform"
}, - "linux_distro": {
- "linux_distro_id": 2,
- "distro_name": "RHEL",
- "distro_version": "8"
}, - "boot_disk_image": "RedHat:RHEL:8-lvm-gen2:latest",
- "created_by": null,
- "modified_by": null,
- "last_update_date": "2024-06-25T14:54:39.990791+00:00",
- "from_date": "2024-06-25T14:54:39.990791+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 5,
- "total_pages": 5,
- "limit": 1,
- "next_page": 2
}
}
Search boot disk image configurations based on boot disk image configuration name.
Retrieves a list of searched boot disk image configurations based on boot disk image configuration name.
Authorizations:
query Parameters
boot_disk_image_name required | string Boot disk image configuration name used for filtering. |
cloud_provider | string Enum: "GCP" "AWS" "Azure" Cloud provider used for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "boot_disk_image_id": 5,
- "boot_disk_image_name": "azure_rhel",
- "description": "Base image for Azure RHEL",
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure",
- "description": "Provider for creating infrastructure on Azure Cloud Platform"
}, - "linux_distro": {
- "linux_distro_id": 2,
- "distro_name": "RHEL",
- "distro_version": "8"
}, - "boot_disk_image": "RedHat:RHEL:8-lvm-gen2:latest",
- "created_by": null,
- "modified_by": null,
- "last_update_date": "2024-06-25T14:54:39.990791+00:00",
- "from_date": "2024-06-25T14:54:39.990791+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 5,
- "total_pages": 5,
- "limit": 1,
- "next_page": 2
}
}
Create a new boot disk image configuration.
Creates a new boot disk image configuration with the provided boot disk image configuration.
Authorizations:
Request Body schema: application/jsonrequired
The boot disk image configuration to be added.
name required | string non-empty The
|
description | string or null non-empty |
boot_disk_image required | string non-empty |
cloud_provider_id required | integer <int64> |
linux_distro_id required | integer <int64> |
Responses
Request samples
- Payload
{- "name": "dev_boot_disk",
- "description": "yeedu dev boot disk",
- "boot_disk_image": "ubuntu-os-cloud/ubuntu-2004-lts",
- "cloud_provider_id": 0,
- "linux_distro_id": 0
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "boot_disk_image_id": "1",
- "boot_disk_image_name": "dev_boot_disk",
- "description": "yeedu dev boot disk",
- "cloud_provider_id": 0,
- "linux_distro_id": 0,
- "boot_disk_image": "ubuntu-os-cloud/ubuntu-2004-lts",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-03-07T04:55:42.799Z",
- "from_date": "2024-03-07T04:55:42.799Z",
- "to_date": null
}
Get details of a specific boot disk image configuration.
Retrieve boot disk image configuration details filtered by boot disk image configuration ID or name.
Authorizations:
query Parameters
boot_disk_image_id | integer <int64> Boot disk image configuration ID used for filtering. |
boot_disk_image_name | string Boot disk image configuration name used for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "boot_disk_image_id": 2,
- "boot_disk_image_name": "gcp_rhel",
- "description": "Base image for GCP RHEL",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP",
- "description": "Provider for creating infrastructure on Google Cloud Platform"
}, - "linux_distro": {
- "linux_distro_id": 2,
- "distro_name": "RHEL",
- "distro_version": "8"
}, - "boot_disk_image": "rhel-cloud/rhel-8",
- "created_by": null,
- "modified_by": null,
- "last_update_date": "2024-06-25T14:54:39.990791+00:00",
- "from_date": "2024-06-25T14:54:39.990791+00:00",
- "to_date": "infinity"
}
Update details of a specific boot disk image configuration.
Authorizations:
query Parameters
boot_disk_image_id | integer <int64> Boot disk image configuration ID used for modification. |
boot_disk_image_name | string Boot disk image configuration name used for modification. |
Request Body schema: application/jsonrequired
The boot disk image configuration to be modified.
name | string non-empty The
|
description | string or null non-empty |
boot_disk_image | string non-empty |
linux_distro_id | integer <int64> |
Responses
Request samples
- Payload
{- "name": "dev_boot_disk",
- "description": "yeedu dev boot disk",
- "boot_disk_image": "ubuntu-os-cloud/ubuntu-2004-lts",
- "linux_distro_id": 0
}
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "boot_disk_image_id": "1",
- "boot_disk_image_name": "dev_boot_disk",
- "description": "yeedu dev boot disk",
- "cloud_provider_id": 0,
- "linux_distro_id": 0,
- "boot_disk_image": "ubuntu-os-cloud/ubuntu-2004-lts",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-03-07T04:55:42.799Z",
- "from_date": "2024-03-07T04:55:42.799Z",
- "to_date": null
}
Delete a specific boot disk image configuration.
Authorizations:
query Parameters
boot_disk_image_id | integer <int64> Boot disk image configuration ID used for deletion. |
boot_disk_image_name | string Boot disk image configuration name used for deletion. |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "Deleted boot disk image configuration ID: 1."
}
Get all the credentials configurations.
Retrieves a list of credentials configurations.
Authorizations:
query Parameters
cloud_provider | string Enum: "GCP" "AWS" "Azure" Cloud provider used for filtering. |
all | boolean Default: false Enum: true false A boolean that can be set to return all the data. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "credentials_conf_id": 6,
- "credentials_conf_name": "azure_credential",
- "description": null,
- "credential_type": {
- "credential_type_id": 2,
- "name": "Azure Service Principal",
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure",
- "description": "Provider for creating infrastructure on Azure Cloud Platform"
}
}, - "tenant_id": "ec234745-4625-4abc-9ae7-1f8a9a9090b3",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-06-27T06:19:09.111391+00:00",
- "from_date": "2024-06-27T06:19:09.111391+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 3,
- "total_pages": 3,
- "limit": 1,
- "next_page": 2
}
}
Search credentials configurations based on credentials configuration name.
Retrieves a list of searched credentials configurations based on credentials configuration name.
Authorizations:
query Parameters
credentials_conf_name required | string Credentials configuration name used for filtering. |
cloud_provider | string Enum: "GCP" "AWS" "Azure" Cloud provider used for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "credentials_conf_id": 6,
- "credentials_conf_name": "azure_credential",
- "description": null,
- "credential_type": {
- "credential_type_id": 2,
- "name": "Azure Service Principal",
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure",
- "description": "Provider for creating infrastructure on Azure Cloud Platform"
}
}, - "tenant_id": "ec234745-4625-4abc-9ae7-1f8a9a9090b3",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-06-27T06:19:09.111391+00:00",
- "from_date": "2024-06-27T06:19:09.111391+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 3,
- "total_pages": 3,
- "limit": 1,
- "next_page": 2
}
}
Create a new credentials configuration.
Creates a new credentials configuration with the provided credentials.
Accepted keys for the base64_encoded_credentials:
Cloud Provider Credential Type Accepted Keys GCP Google Service Account ['TYPE', 'PROJECT_ID', 'PRIVATE_KEY_ID', 'PRIVATE_KEY', 'CLIENT_EMAIL', 'CLIENT_ID', 'AUTH_URI', 'TOKEN_URI', 'AUTH_PROVIDER_X509_CERT_URL', 'CLIENT_X509_CERT_URL'] AWS Access Secret Key Pair ['AWS_ACCESS_KEY_ID', 'AWS_SECRET_ACCESS_KEY', 'AWS_DEFAULT_REGION'] Azure Azure Service Principal ['CLIENT_ID', 'TENANT_ID', 'CLIENT_SECRET', 'SUBSCRIPTION_ID', 'STORAGE_ACCOUNT_NAME', 'CONTAINER_NAME']
Authorizations:
Request Body schema: application/jsonrequired
The credentials configuration to be added.
name required | string non-empty The
|
description | string or null non-empty |
credential_type_id required | integer <int64> |
required | object |
Responses
Request samples
- Payload
{- "name": "yeedu-aws",
- "description": "yeedu credentials configuration",
- "credential_type_id": 1,
- "base64_encoded_credentials": {
- "encoded": "ewogIkFXU19BQ0NFU1NfS0VZX0lEIjogIkFXU19BQ0NFU1NfS0VZX0lEIiwKICJBV1NfU0VDUkVUX0FDQ0VTU19LRVkiOiAiQVdTX1NFQ1JFVF9BQ0NFU1NfS0VZIiwKICJBV1NfREVGQVVMVF9SRUdJT04iOiJBV1NfREVGQVVMVF9SRUdJT04iCn0="
}
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "credentials_conf_id": "1",
- "name": "yeedu-svc",
- "description": "yeedu credentials configuration",
- "credential_type_id": "0",
- "tenant_id": "d9d98a22-5216-4955-b3d9-b0337d8ac0d9",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-03-08T12:18:49.334Z",
- "from_date": "2024-03-08T12:18:49.334Z",
- "to_date": null
}
Get details of a specific credentials configuration.
Retrieve credentials configuration details filtered by credentials configuration ID or name.
Authorizations:
query Parameters
credentials_conf_id | integer <int64> Credentials configuration ID used for filtering. |
credentials_conf_name | string Credentials configuration name used for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "credentials_conf_id": 1,
- "credentials_conf_name": "aws_credential",
- "description": null,
- "credential_type": {
- "credential_type_id": 1,
- "name": "AWS Access Secret Key Pair",
- "cloud_provider": {
- "cloud_provider_id": 1,
- "name": "AWS",
- "description": "Provider for creating infrastructure on Amazon Web Services"
}
}, - "tenant_id": "ec234745-4625-4abc-9ae7-1f8a9a9090b3",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-06-26T04:58:48.922845+00:00",
- "from_date": "2024-06-26T04:58:48.922845+00:00",
- "to_date": "infinity"
}
Update details of a specific credentials configuration.
Updates an existing credentials configuration with the provided credentials.
Accepted keys for the base64_encoded_credentials:
Cloud Provider Credential Type Accepted Keys GCP Google Service Account ['TYPE', 'PROJECT_ID', 'PRIVATE_KEY_ID', 'PRIVATE_KEY', 'CLIENT_EMAIL', 'CLIENT_ID', 'AUTH_URI', 'TOKEN_URI', 'AUTH_PROVIDER_X509_CERT_URL', 'CLIENT_X509_CERT_URL'] AWS Access Secret Key Pair ['AWS_ACCESS_KEY_ID', 'AWS_SECRET_ACCESS_KEY', 'AWS_DEFAULT_REGION'] Azure Azure Service Principal ['CLIENT_ID', 'TENANT_ID', 'CLIENT_SECRET', 'SUBSCRIPTION_ID', 'STORAGE_ACCOUNT_NAME', 'CONTAINER_NAME']
Authorizations:
query Parameters
credentials_conf_id | integer <int64> Credentials configuration ID used for modification. |
credentials_conf_name | string Credentials configuration name used for modification. |
Request Body schema: application/jsonrequired
The credentials configuration to be modified.
name | string non-empty The
|
description | string or null non-empty |
object |
Responses
Request samples
- Payload
{- "name": "yeedu-aws",
- "description": "yeedu credentials configuration",
- "base64_encoded_credentials": {
- "encoded": "ewogIkFXU19BQ0NFU1NfS0VZX0lEIjogIkFXU19BQ0NFU1NfS0VZX0lEIiwKICJBV1NfU0VDUkVUX0FDQ0VTU19LRVkiOiAiQVdTX1NFQ1JFVF9BQ0NFU1NfS0VZIiwKICJBV1NfREVGQVVMVF9SRUdJT04iOiJBV1NfREVGQVVMVF9SRUdJT04iCn0="
}
}
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "credentials_conf_id": "1",
- "name": "yeedu-svc",
- "description": "yeedu credentials configuration",
- "credential_type_id": "0",
- "tenant_id": "d9d98a22-5216-4955-b3d9-b0337d8ac0d9",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-03-08T12:18:49.334Z",
- "from_date": "2024-03-08T12:18:49.334Z",
- "to_date": null
}
Delete a specific credentials configuration.
Authorizations:
query Parameters
credentials_conf_id | integer <int64> Credentials configuration ID used for deletion. |
credentials_conf_name | string Credentials configuration name used for deletion. |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "Deleted credentials configuration ID: 1"
}
Get all the cloud environments.
Retrieves a list of cloud environments.
Authorizations:
query Parameters
cloud_provider | string Enum: "GCP" "AWS" "Azure" Cloud provider used for filtering. |
all | boolean Default: false Enum: true false A boolean that can be set to return all the data. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "cloud_env_id": 21,
- "cloud_env_name": "azure_cloud_env",
- "description": "",
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure",
- "description": "Provider for creating infrastructure on Azure Cloud Platform"
}, - "availability_zone": {
- "availability_zone_id": 128,
- "name": "Central US",
- "region": "Central US",
- "description": "US, North America"
}, - "network_config": {
- "network_conf_id": 7,
- "name": "azure_test_network",
- "description": "creating network config in Azure cloud",
- "network_project_id": "yeedu-project",
- "network_name": "yeedu-network",
- "network_tags": [
- "yeedu",
- "iap-allow"
], - "subnet": "yeedu-subnet",
- "availability_zone": {
- "availability_zone_id": 129,
- "name": "East US",
- "region": "East US",
- "description": "US, North America"
}
}, - "cloud_project": "12345678",
- "credential_config": {
- "credential_conf_id": 8,
- "name": "azure_test_credential",
- "description": null,
- "credential_type": {
- "credential_type_id": 2,
- "name": "Azure Service Principal"
}
}, - "boot_disk_image": {
- "boot_disk_image_id": 4,
- "name": "azure_ubuntu",
- "description": "Base image for Azure Ubuntu",
- "linux_distro": {
- "linux_distro_id": 1,
- "distro_name": "UBUNTU",
- "distro_version": "22.04 LTS"
}, - "boot_disk_image": "Canonical:0001-com-ubuntu-server-jammy:22_04-lts-gen2:latest"
}, - "tenant_id": "a6a9c5ea-57b6-4a1c-aa99-84645f675b62",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-05-02T09:15:58.363635+00:00",
- "from_date": "2024-05-02T09:15:58.363635+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 11,
- "total_pages": 11,
- "limit": 1,
- "next_page": 2
}
}
Search cloud environments based on cloud environment name.
Retrieves a list of searched cloud environments based on cloud environment name.
Authorizations:
query Parameters
cloud_env_name required | string Cloud environment name used for filtering. |
cloud_provider | string Enum: "GCP" "AWS" "Azure" Cloud provider used for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "cloud_env_id": 21,
- "cloud_env_name": "azure_cloud_env",
- "description": "",
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure",
- "description": "Provider for creating infrastructure on Azure Cloud Platform"
}, - "availability_zone": {
- "availability_zone_id": 128,
- "name": "Central US",
- "region": "Central US",
- "description": "US, North America"
}, - "network_config": {
- "network_conf_id": 7,
- "name": "azure_test_network",
- "description": "creating network config in Azure cloud",
- "network_project_id": "yeedu-project",
- "network_name": "yeedu-network",
- "network_tags": [
- "yeedu",
- "iap-allow"
], - "subnet": "yeedu-subnet",
- "availability_zone": {
- "availability_zone_id": 129,
- "name": "East US",
- "region": "East US",
- "description": "US, North America"
}
}, - "cloud_project": "12345678",
- "credential_config": {
- "credential_conf_id": 8,
- "name": "azure_test_credential",
- "description": null,
- "credential_type": {
- "credential_type_id": 2,
- "name": "Azure Service Principal"
}
}, - "boot_disk_image": {
- "boot_disk_image_id": 4,
- "name": "azure_ubuntu",
- "description": "Base image for Azure Ubuntu",
- "linux_distro": {
- "linux_distro_id": 1,
- "distro_name": "UBUNTU",
- "distro_version": "22.04 LTS"
}, - "boot_disk_image": "Canonical:0001-com-ubuntu-server-jammy:22_04-lts-gen2:latest"
}, - "tenant_id": "a6a9c5ea-57b6-4a1c-aa99-84645f675b62",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-05-02T09:15:58.363635+00:00",
- "from_date": "2024-05-02T09:15:58.363635+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 11,
- "total_pages": 11,
- "limit": 1,
- "next_page": 2
}
}
Create a new cloud environment.
Creates a new cloud environment with provided cloud environment.
Authorizations:
Request Body schema: application/jsonrequired
The cloud environment to be added.
name required | string non-empty The
|
description | string or null non-empty |
cloud_provider_id required | integer <int32> |
availability_zone_id required | integer <int64> |
network_conf_id required | integer <int64> |
cloud_project required | string non-empty |
credential_config_id required | integer <int64> |
boot_disk_image_id required | integer <int64> |
Responses
Request samples
- Payload
{- "name": "yeedu_cloud_env",
- "description": "yeedu cloud environment",
- "cloud_provider_id": 0,
- "availability_zone_id": 75,
- "network_conf_id": 1,
- "cloud_project": "yeedu",
- "credential_config_id": 1,
- "boot_disk_image_id": 1
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "cloud_env_id": 1,
- "name": "yeedu_cloud_env",
- "description": "yeedu cloud environment",
- "cloud_provider_id": "0",
- "availability_zone_id": "75",
- "network_conf_id": "1",
- "cloud_project": "yeedu",
- "credential_config_id": "1",
- "boot_disk_image_id": "1",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-03-08T13:45:15.0882Z",
- "from_date": "2024-03-08T13:45:15.0882Z",
- "to_date": null
}
Get details of a specific cloud environment.
Retrieve cloud environment details filtered by cloud environment ID or name.
Authorizations:
query Parameters
cloud_env_id | integer <int64> Cloud environment ID used for filtering. |
cloud_env_name | string Cloud environment name used for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "cloud_env_id": 21,
- "cloud_env_name": "azure_cloud_env",
- "description": "",
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure",
- "description": "Provider for creating infrastructure on Azure Cloud Platform"
}, - "availability_zone": {
- "availability_zone_id": 128,
- "name": "Central US",
- "region": "Central US",
- "description": "US, North America"
}, - "network_config": {
- "network_conf_id": 7,
- "name": "azure_test_network",
- "description": "creating network config in Azure cloud",
- "network_project_id": "yeedu-project",
- "network_name": "yeedu-network",
- "network_tags": [
- "yeedu",
- "iap-allow"
], - "subnet": "yeedu-subnet",
- "availability_zone": {
- "availability_zone_id": 129,
- "name": "East US",
- "region": "East US",
- "description": "US, North America"
}
}, - "cloud_project": "12345678",
- "credential_config": {
- "credential_conf_id": 8,
- "name": "azure_test_credential",
- "description": null,
- "credential_type": {
- "credential_type_id": 2,
- "name": "Azure Service Principal"
}
}, - "boot_disk_image": {
- "boot_disk_image_id": 4,
- "name": "azure_ubuntu",
- "description": "Base image for Azure Ubuntu",
- "linux_distro": {
- "linux_distro_id": 1,
- "distro_name": "UBUNTU",
- "distro_version": "22.04 LTS"
}, - "boot_disk_image": "Canonical:0001-com-ubuntu-server-jammy:22_04-lts-gen2:latest"
}, - "tenant_id": "a6a9c5ea-57b6-4a1c-aa99-84645f675b62",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-05-02T09:15:58.363635+00:00",
- "from_date": "2024-05-02T09:15:58.363635+00:00",
- "to_date": "infinity"
}
Update details of a specific cloud environment.
Authorizations:
query Parameters
cloud_env_id | integer <int64> Cloud environment ID used for modification. |
cloud_env_name | string Cloud environment name used for modification. |
Request Body schema: application/jsonrequired
The cloud environment details to be modified.
name | string non-empty The
|
description | string or null non-empty |
availability_zone_id | integer <int64> |
network_conf_id | integer <int64> |
cloud_project | string non-empty |
credential_config_id | integer <int64> |
boot_disk_image_id | integer <int64> |
Responses
Request samples
- Payload
{- "name": "gcp_cloud_env",
- "description": "yeedu cloud environment",
- "availability_zone_id": 75,
- "network_conf_id": 1,
- "cloud_project": "yeedu",
- "credential_config_id": 1,
- "boot_disk_image_id": 1
}
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "cloud_env_id": 1,
- "name": "yeedu_cloud_env",
- "description": "yeedu cloud environment",
- "cloud_provider_id": "0",
- "availability_zone_id": "75",
- "network_conf_id": "1",
- "cloud_project": "yeedu",
- "credential_config_id": "1",
- "boot_disk_image_id": "1",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-03-08T13:45:15.0882Z",
- "from_date": "2024-03-08T13:45:15.0882Z",
- "to_date": null
}
Delete a specific cloud environment.
Authorizations:
query Parameters
cloud_env_id | integer <int64> Cloud environment ID used for deletion. |
cloud_env_name | string Cloud environment name used for deletion. |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "Deleted cloud environment ID: 1."
}
Get all the object storage manager configurations.
Retrieves a list of object storage manager configurations.
Authorizations:
query Parameters
cloud_provider | string Enum: "GCP" "AWS" "Azure" Cloud provider used for filtering. |
all | boolean Default: false Enum: true false A boolean that can be set to return all the data. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "object_storage_manager_id": 1,
- "object_storage_manager_name": "yeedu_osm",
- "description": "Yeedu Object Storage Manager",
- "cloud_provider": {
- "name": "GCP",
- "description": "Provider for creating infrastructure on Google Cloud Platform"
}, - "object_storage_bucket_name": "yeedu-dev",
- "credentials_config": {
- "name": "yeedu_credential_f24842b5-7e38-40f4-8a5d-98f75c269bd8",
- "credential_type": {
- "name": "Google Service Account"
}
}, - "tenant_id": "cf1f945f-01ce-4ac6-a070-8c733f2fa791",
- "created_by": {
- "user_id": 1,
- "username": "YSU0000"
}, - "modified_by": {
- "user_id": 1,
- "username": "YSU0000"
}, - "last_update_date": "2023-09-29T15:49:59.477968+00:00",
- "from_date": "2023-09-29T15:49:59.477968+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 100
}
}
Search object storage manager configurations based on object storage manager name.
Retrieves a list of searched object storage manager configurations based on object storage manager name.
Authorizations:
query Parameters
object_storage_manager_name required | string Object storage manager name used for filtering |
cloud_provider | string Enum: "GCP" "AWS" "Azure" Cloud provider used for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "object_storage_manager_id": 1,
- "object_storage_manager_name": "yeedu_osm",
- "description": "Yeedu Object Storage Manager",
- "cloud_provider": {
- "name": "GCP",
- "description": "Provider for creating infrastructure on Google Cloud Platform"
}, - "object_storage_bucket_name": "yeedu-dev",
- "credentials_config": {
- "name": "yeedu_credential_f24842b5-7e38-40f4-8a5d-98f75c269bd8",
- "credential_type": {
- "name": "Google Service Account"
}
}, - "tenant_id": "cf1f945f-01ce-4ac6-a070-8c733f2fa791",
- "created_by": {
- "user_id": 1,
- "username": "YSU0000"
}, - "modified_by": {
- "user_id": 1,
- "username": "YSU0000"
}, - "last_update_date": "2023-09-29T15:49:59.477968+00:00",
- "from_date": "2023-09-29T15:49:59.477968+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 100
}
}
Create a new object storage manager configuration
Creates a new object storage manager configuration with provided object storage manager configuration.
Authorizations:
Request Body schema: application/jsonrequired
The object storage manager configuration to be added.
name required | string non-empty The
|
description | string or null non-empty |
cloud_provider_id required | integer <int32> |
credentials_conf_id required | integer <int64> |
object_storage_bucket_name required | string non-empty |
Responses
Request samples
- Payload
{- "name": "yeedu_osm",
- "description": "Yeedu Object Storage Manager",
- "cloud_provider_id": 0,
- "credentials_conf_id": 1,
- "object_storage_bucket_name": "yeedu"
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "object_storage_manager_id": "1",
- "name": "yeedu_osm",
- "description": "Yeedu Object Storage Manager",
- "cloud_provider_id": "0",
- "credentials_conf_id": "1",
- "object_storage_bucket_name": "yeedu",
- "tenant_id": "d9d98a22-5216-4955-b3d9-b0337d8ac0d9",
- "created_by_user_id": "3",
- "modified_by_user_id": "3",
- "last_update_date": "2023-03-17T09:31:42.221Z",
- "from_date": "2023-03-17T09:31:42.221Z",
- "to_date": null
}
Get details of a specific object storage manager configuration.
Retrieve object storage manager configuration details filtered by ID or name.
Authorizations:
query Parameters
object_storage_manager_id | integer <int64> Object storage manager configuration ID used for filtering. |
object_storage_manager_name | string Object storage manager configuration name used for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "object_storage_manager_id": 1,
- "object_storage_manager_name": "yeedu_osm",
- "description": "Yeedu Object Storage Manager",
- "cloud_provider": {
- "name": "GCP",
- "description": "Provider for creating infrastructure on Google Cloud Platform"
}, - "object_storage_bucket_name": "yeedu-dev",
- "credentials_config": {
- "name": "yeedu_credential_f24842b5-7e38-40f4-8a5d-98f75c269bd8",
- "credential_type": {
- "name": "GCP"
}
}, - "tenant_id": "cf1f945f-01ce-4ac6-a070-8c733f2fa791",
- "created_by": {
- "user_id": 1,
- "username": "YSU0000"
}, - "modified_by": {
- "user_id": 1,
- "username": "YSU0000"
}, - "last_update_date": "2023-09-29T15:49:59.477968+00:00",
- "from_date": "2023-09-29T15:49:59.477968+00:00",
- "to_date": "infinity"
}
Update details of a specific object storage manager configuration.
Authorizations:
query Parameters
object_storage_manager_id | integer <int64> Object storage manager configuration ID used for modification. |
object_storage_manager_name | string Object storage manager configuration name used for modification. |
Request Body schema: application/jsonrequired
Object storage manager configuration details to be modified.
name | string non-empty The
|
description | string or null non-empty |
credentials_conf_id | integer <int64> |
Responses
Request samples
- Payload
{- "name": "yeedu_osm",
- "description": "Yeedu Object Storage Manager",
- "credentials_conf_id": 1
}
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "object_storage_manager_id": "1",
- "name": "yeedu_osm",
- "description": "Yeedu Object Storage Manager",
- "cloud_provider_id": "0",
- "credentials_conf_id": "1",
- "object_storage_bucket_name": "yeedu",
- "tenant_id": "d9d98a22-5216-4955-b3d9-b0337d8ac0d9",
- "created_by_user_id": "3",
- "modified_by_user_id": "3",
- "last_update_date": "2023-03-17T09:31:42.221Z",
- "from_date": "2023-03-17T09:31:42.221Z",
- "to_date": null
}
Delete a specific object storage manager configuration.
Authorizations:
query Parameters
object_storage_manager_id | integer <int64> Object storage manager configuration ID used for deletion. |
object_storage_manager_name | string Object storage manager configuration name used for deletion. |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "Deleted Object Storage Manager Configuration: 1"
}
Get all the object storage manager files.
Retrieves a list of object storage manager files for a specific object storage manager configuration ID or name.
Authorizations:
query Parameters
object_storage_manager_id | integer <int64> Object storage manager configuration ID used for filtering. |
object_storage_manager_name | string Object storage manager configuration name used for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "object_storage_manager_file_id": 68,
- "object_storage_manager": {
- "object_storage_manager_id": 1,
- "object_storage_manager_name": "aws_health_transformation_osm",
- "description": null,
- "cloud_provider": {
- "name": "AWS",
- "description": "Provider for creating infrastructure on Amazon Web Services"
}, - "credentials_config": {
- "credential_config_id": 1,
- "name": "aws_genomic_security",
- "description": null,
- "credential_type": {
- "credential_type_id": 1,
- "name": "AWS Access Secret Key Pair"
}
}, - "object_storage_bucket_name": "yeedu"
}, - "file_name": "hive-jdbc-1.0.jar",
- "full_file_path": "file:///yeedu/object-storage-manager/hive-jdbc-1.0.jar",
- "file_size_bytes": "18255759",
- "file_type": "jar",
- "tenant_id": "a6a9c5ea-57b6-4a1c-aa99-84645f675b62",
- "created_by": {
- "user_id": 6,
- "username": "ysu0000@yeedu.io"
}, - "modified_by": {
- "user_id": 6,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-04-25T15:17:04.683271+00:00",
- "from_date": "2024-04-25T15:17:04.683271+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 12,
- "total_pages": 12,
- "limit": 1,
- "next_page": 2
}
}
Upload file to an object storage manager.
Upload a file to a specified object storage manager configuration ID or name.
- overwrite: A boolean parameter indicating whether the file should overwrite any existing file in the object storage manager. The default value is false.
Authorizations:
query Parameters
object_storage_manager_id | integer <int64> Object storage manager configuration ID used for filtering. |
object_storage_manager_name | string Object storage manager configuration name used for filtering. |
overwrite | boolean Default: false Enum: true false Boolean flag to indicate whether to overwrite existing files. |
Request Body schema: multipart/form-datarequired
File to upload to an object storage manager.
fileObject required | string <binary> |
Responses
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "object_storage_manager_file_id": "76",
- "object_storage_manager_id": "20",
- "file_name": "spark-examples_2.12-3.2.2.jar",
- "full_file_path": "file:///yeedu/object-storage-manager/spark-examples_2.12-3.2.2.jar",
- "file_size_bytes": "1560870",
- "file_type": "jar",
- "tenant_id": "a6a9c5ea-57b6-4a1c-aa99-84645f675b62",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-05-08T06:26:52.461Z",
- "from_date": "2024-05-08T06:26:52.461Z",
- "to_date": null
}
Search object storage manager files based on file name.
Retrieve a list of object storage manager files based on file name search for a specific configuration ID or name.
Authorizations:
query Parameters
file_name required | string Object storage manager file name used for filtering. |
object_storage_manager_id | integer <int64> Object storage manager configuration ID used for filtering. |
object_storage_manager_name | string Object storage manager configuration name used for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "object_storage_manager_file_id": 68,
- "object_storage_manager": {
- "object_storage_manager_id": 1,
- "object_storage_manager_name": "aws_health_transformation_osm",
- "description": null,
- "cloud_provider": {
- "name": "AWS",
- "description": "Provider for creating infrastructure on Amazon Web Services"
}, - "credentials_config": {
- "credential_config_id": 1,
- "name": "aws_genomic_security",
- "description": null,
- "credential_type": {
- "credential_type_id": 1,
- "name": "AWS Access Secret Key Pair"
}
}, - "object_storage_bucket_name": "yeedu"
}, - "file_name": "hive-jdbc-1.0.jar",
- "full_file_path": "file:///yeedu/object-storage-manager/hive-jdbc-1.0.jar",
- "file_size_bytes": "18255759",
- "file_type": "jar",
- "tenant_id": "a6a9c5ea-57b6-4a1c-aa99-84645f675b62",
- "created_by": {
- "user_id": 6,
- "username": "ysu0000@yeedu.io"
}, - "modified_by": {
- "user_id": 6,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-04-25T15:17:04.683271+00:00",
- "from_date": "2024-04-25T15:17:04.683271+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 12,
- "total_pages": 12,
- "limit": 1,
- "next_page": 2
}
}
Get details of a specific object storage manager file.
Retrieve details of an object storage manager file filtered by its configuration ID or name, along with file ID or name.
Authorizations:
query Parameters
object_storage_manager_id | integer <int64> Object storage manager configuration ID used for filtering. |
object_storage_manager_name | string Object storage manager configuration name used for filtering. |
file_id | integer <int64> Object storage manager file ID used for filtering. |
file_name | string Object storage manager file name used for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "object_storage_manager_file_id": 68,
- "object_storage_manager": {
- "object_storage_manager_id": 1,
- "object_storage_manager_name": "aws_health_transformation_osm",
- "description": null,
- "cloud_provider": {
- "name": "AWS",
- "description": "Provider for creating infrastructure on Amazon Web Services"
}, - "credentials_config": {
- "credential_config_id": 1,
- "name": "aws_genomic_security",
- "description": null,
- "credential_type": {
- "credential_type_id": 1,
- "name": "AWS Access Secret Key Pair"
}
}, - "object_storage_bucket_name": "yeedu"
}, - "file_name": "hive-jdbc-1.0.jar",
- "full_file_path": "file:///yeedu/object-storage-manager/hive-jdbc-1.0.jar",
- "file_size_bytes": "18255759",
- "file_type": "jar",
- "tenant_id": "a6a9c5ea-57b6-4a1c-aa99-84645f675b62",
- "created_by": {
- "user_id": 6,
- "username": "ysu0000@yeedu.io"
}, - "modified_by": {
- "user_id": 6,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-04-25T15:17:04.683271+00:00",
- "from_date": "2024-04-25T15:17:04.683271+00:00",
- "to_date": "infinity"
}
Delete a specific object storage manager file.
Delete an object storage manager file filtered by its configuration ID or name, along with the file ID or name.
Authorizations:
query Parameters
object_storage_manager_id | integer <int64> Object storage manager configuration ID used for filtering. |
object_storage_manager_name | string Object storage manager configuration name used for filtering. |
file_id | integer <int64> Object storage manager file ID used for deletion. |
file_name | string Object storage manager file name used for deletion. |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "The File spark-sql_2.12-3.2.0.jar has been deleted."
}
Get all the Hive metastore configurations.
Retrieves a list of Hive metastore configurations.
Authorizations:
query Parameters
all | boolean Default: false Enum: true false A boolean that can be set to return all the data. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "hive_metastore_conf_id": 2,
- "hive_metastore_conf_name": "metastore_conf",
- "tenant_id": "a6a9c5ea-57b6-4a1c-aa99-84645f675b62",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-05-03T13:59:50.858321+00:00",
- "from_date": "2024-05-03T13:59:50.858321+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 1
}
}
Search Hive metastore configurations based on configuration name.
Retrieve a list of Hive metastore configurations based on the configuration name search.
Authorizations:
query Parameters
hive_metastore_conf_name required | string Hive metastore configuration name used for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "hive_metastore_conf_id": 2,
- "hive_metastore_conf_name": "metastore_conf",
- "tenant_id": "a6a9c5ea-57b6-4a1c-aa99-84645f675b62",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-05-03T13:59:50.858321+00:00",
- "from_date": "2024-05-03T13:59:50.858321+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 1
}
}
Create a new Hive Metastore Configuration
Create a new Hive metastore configuration with valid XML and krb5 conf content.
Authorizations:
Request Body schema: application/jsonrequired
The Hive metastore configuration to be added.
name required | string non-empty The
|
description | string or null non-empty |
hiveSiteXml | string or null non-empty |
coreSiteXml | string or null non-empty |
hdfsSiteXml | string or null non-empty |
krb5Conf | string or null non-empty |
Responses
Request samples
- Payload
{- "name": "yeedu_hive_conf",
- "description": "This is a test hive description",
- "hiveSiteXml": "string",
- "coreSiteXml": "string",
- "hdfsSiteXml": "string",
- "krb5Conf": "string"
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "hive_metastore_conf_id": "1",
- "name": "yeedu_hive_conf",
- "description": "This is a test hive description",
- "tenant_id": "e67f00ad-68aa-46d0-b32e-f3f8dac5427d",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2023-09-29T07:37:52.309Z",
- "from_date": "2023-09-29T07:37:52.309Z",
- "to_date": null
}
Get details of a specific Hive metastore configuration.
Retrieve Hive metastore configuration details filtered by ID or name.
Authorizations:
query Parameters
hive_metastore_conf_id | integer <int64> Hive metastore configuration ID used for filtering. |
hive_metastore_conf_name | string Hive metastore configuration name used for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "hive_metastore_conf_id": 2,
- "hive_metastore_conf_name": "metastore_conf",
- "tenant_id": "a6a9c5ea-57b6-4a1c-aa99-84645f675b62",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-05-03T13:59:50.858321+00:00",
- "from_date": "2024-05-03T13:59:50.858321+00:00",
- "to_date": "infinity"
}
Update details of a specific Hive metastore configuration.
Authorizations:
query Parameters
hive_metastore_conf_id | integer <int64> Hive metastore configuration ID used for modification. |
hive_metastore_conf_name | string Hive metastore configuration name used for modification. |
Request Body schema: application/jsonrequired
Hive metastore configuration details to be modified.
name | string non-empty The
|
description | string or null non-empty |
hiveSiteXml | string or null non-empty |
coreSiteXml | string or null non-empty |
hdfsSiteXml | string or null non-empty |
krb5Conf | string or null non-empty |
Responses
Request samples
- Payload
{- "name": "yeedu_hive_conf",
- "description": "This is a test hive description",
- "hiveSiteXml": null,
- "coreSiteXml": null,
- "hdfsSiteXml": null,
- "krb5Conf": null
}
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "hive_metastore_conf_id": "1",
- "name": "yeedu_hive_conf",
- "description": "This is a test hive description",
- "tenant_id": "e67f00ad-68aa-46d0-b32e-f3f8dac5427d",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2023-09-29T07:37:52.309Z",
- "from_date": "2023-09-29T07:37:52.309Z",
- "to_date": null
}
Delete a specific Hive metastore configuration.
Authorizations:
query Parameters
hive_metastore_conf_id | integer <int64> Hive metastore configuration ID used for deletion. |
hive_metastore_conf_name | string Hive metastore configuration name used for deletion. |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "Deleted Hive Metastore Configuration Id: 1"
}
Get all the cluster configurations.
Retrieves a list of cluster configurations.
Authorizations:
query Parameters
cloud_provider | string Enum: "GCP" "AWS" "Azure" Cloud provider used for filtering. |
compute_type | string Enum: "compute_optimized" "memory_optimized" "general_purpose" "gpu_accelerated" "custom_compute" Compute type used for filtering. |
all | boolean Default: false Enum: true false A boolean that can be set to return all the data. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "cluster_conf_id": 60,
- "cluster_conf_name": "Standard_F2s_v24",
- "description": null,
- "machine_type_category": "compute_optimized",
- "machine_type": {
- "machine_type_id": 214,
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure"
}, - "name": "Standard_F2s_v24",
- "vCPUs": 2,
- "memory": "4 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon® Platinum 8168 (SkyLake)"
], - "cpu_min_frequency_GHz": [
- "2.7"
], - "cpu_max_frequency_GHz": [
- "3.7"
], - "has_local_disk": true,
- "local_disk_size_GB": 16,
- "local_num_of_disks": 1,
- "local_disk_bus_type": {
- "local_disk_bus_type_id": 0,
- "local_disk_bus_type": "SCSI"
}, - "local_disk_throughput_MB": null,
- "machine_price_ycu": 0.73
}, - "machine_volume_conf": null,
- "created_by": null,
- "modified_by": null,
- "last_update_date": "2024-04-05T14:17:18.031635+00:00",
- "from_date": "2024-04-05T14:17:18.031635+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 261,
- "total_pages": 261,
- "limit": 1,
- "next_page": 2
}
}
Search cluster configurations based on configuration name.
Retrieve a list of cluster configurations based on the configuration name search.
Authorizations:
query Parameters
cluster_conf_name required | string Specifies the name of the cluster configuration for the search. |
cloud_provider | string Enum: "GCP" "AWS" "Azure" Cloud provider used for filtering. |
compute_type | string Enum: "compute_optimized" "memory_optimized" "general_purpose" "gpu_accelerated" "custom_compute" Compute type used for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "cluster_conf_id": 60,
- "cluster_conf_name": "Standard_F2s_v24",
- "description": null,
- "machine_type_category": "compute_optimized",
- "machine_type": {
- "machine_type_id": 214,
- "cloud_provider": {
- "cloud_provider_id": 2,
- "name": "Azure"
}, - "name": "Standard_F2s_v24",
- "vCPUs": 2,
- "memory": "4 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon® Platinum 8168 (SkyLake)"
], - "cpu_min_frequency_GHz": [
- "2.7"
], - "cpu_max_frequency_GHz": [
- "3.7"
], - "has_local_disk": true,
- "local_disk_size_GB": 16,
- "local_num_of_disks": 1,
- "local_disk_bus_type": {
- "local_disk_bus_type_id": 0,
- "local_disk_bus_type": "SCSI"
}, - "local_disk_throughput_MB": null,
- "machine_price_ycu": 0.73
}, - "machine_volume_conf": null,
- "created_by": null,
- "modified_by": null,
- "last_update_date": "2024-04-05T14:17:18.031635+00:00",
- "from_date": "2024-04-05T14:17:18.031635+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 261,
- "total_pages": 261,
- "limit": 1,
- "next_page": 2
}
}
Create a new cluster configuration.
Creates a new cluster configuration with provided configurations.
Authorizations:
Request Body schema: application/jsonrequired
Cluster configuration to be added.
name required | string non-empty The
|
description | string or null non-empty |
machine_type_id required | integer <int64> |
volume_conf_id | integer <int64> |
Responses
Request samples
- Payload
{- "name": "yeedu_cluster",
- "description": "Cluster Configurations test",
- "machine_type_id": 76,
- "volume_conf_id": 1
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "cluster_conf_id": "1",
- "name": "yeedu_cluster",
- "description": "Cluster Configurations test",
- "machine_type_category_id": "1",
- "machine_type_id": "1",
- "volume_conf_id": "1",
- "created_by_user_id": "3",
- "modified_by_user_id": "3",
- "last_update_date": "2023-03-17T10:20:21.627Z",
- "from_date": "2023-03-17T10:20:21.627Z",
- "to_date": null
}
Get details of a specific cluster configuration.
Retrieve cluster configuration details filtered by ID or name.
Authorizations:
query Parameters
cluster_conf_id | integer <int64> Cluster configuration ID used for filtering. |
cluster_conf_name | string Cluster configuration name used for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "cluster_conf_id": 261,
- "cluster_conf_name": "cluster_conf",
- "description": "creating aws cluster configuration",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 91,
- "cloud_provider": {
- "cloud_provider_id": 1,
- "name": "AWS",
- "description": "Provider for creating infrastructure on Amazon Web Services"
}, - "name": "m5d.xlarge",
- "vCPUs": 4,
- "memory": "16 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xenon Platinum 8175"
], - "cpu_min_frequency_GHz": [
- "2.5"
], - "cpu_max_frequency_GHz": [
- "3.1"
], - "has_local_disk": true,
- "local_disk_size_GB": 150,
- "local_num_of_disks": 1,
- "local_disk_bus_type": {
- "local_disk_bus_type_id": 1,
- "local_disk_bus_type": "NVME"
}, - "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.27
}, - "machine_volume_conf": {
- "volume_conf_id": 25,
- "name": "yeedu_aws_volume",
- "encrypted": true,
- "size": 200,
- "disk_type": {
- "disk_type_id": 3,
- "cloud_provider": {
- "cloud_provider_id": 1,
- "name": "AWS"
}, - "name": "gp2",
- "has_fixed_size": false,
- "min_size": 1,
- "max_size": 16000
}, - "machine_volume_num": 1,
- "machine_volume_strip_num": 1,
- "disk_iops": null,
- "disk_throughput_MB": null,
- "disk_num": 1,
- "disk_size": 200
}, - "created_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-04-12T13:27:29.754832+00:00",
- "from_date": "2024-04-12T13:27:29.754832+00:00",
- "to_date": "infinity"
}
Update details of a specific cluster configuration.
Authorizations:
query Parameters
cluster_conf_id | integer <int64> Cluster configuration ID used for modification. |
cluster_conf_name | string Cluster configuration name used for modification. |
Request Body schema: application/jsonrequired
Cluster configuration details to be modified.
name | string non-empty The
|
description | string or null non-empty |
machine_type_id | integer <int64> |
volume_conf_id | integer or null <int64> |
Responses
Request samples
- Payload
{- "name": "Yeedu Cluster Configuration",
- "description": "Cluster Configurations test",
- "machine_type_id": 75,
- "volume_conf_id": 1
}
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "cluster_conf_id": "1",
- "name": "yeedu_cluster",
- "description": "Cluster Configurations test",
- "machine_type_category_id": "1",
- "machine_type_id": "1",
- "volume_conf_id": "1",
- "created_by_user_id": "3",
- "modified_by_user_id": "3",
- "last_update_date": "2023-03-17T10:20:21.627Z",
- "from_date": "2023-03-17T10:20:21.627Z",
- "to_date": null
}
Delete a specific cluster configuration.
Authorizations:
query Parameters
cluster_conf_id | integer <int64> Cluster configuration ID used for deletion. |
cluster_conf_name | string Cluster configuration name used for deletion. |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "Deleted Cluster Configuration Id: 1"
}
Get all the cluster instances.
Retrieves a list of cluster instances.
Authorizations:
query Parameters
cluster_status | Array of strings Items Enum: "INITIATING" "RUNNING" "STOPPING" "STOPPED" "DESTROYING" "DESTROYED" "ERROR" "RESIZING_UP" "RESIZING_DOWN" Specifies the cluster instance statuses to be used as a filter. |
cluster_conf_id | integer <int64> Cluster configuration ID used for filtering. |
cluster_conf_name | string Cluster configuration name used for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "cluster_id": 21,
- "name": "test-cluster",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "total_ycu": 597.237,
- "cloud_env": {
- "cloud_env_id": 1,
- "name": "aws_load_test_cloud_env",
- "cloud_provider": {
- "cloud_provider_id": 1,
- "name": "AWS"
}
}, - "cluster_conf": {
- "cluster_conf_id": 156,
- "cluster_conf_name": "m5dn.xlarge",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 99,
- "name": "m5dn.xlarge",
- "vCPUs": 4,
- "memory": "16 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Platinum 8259"
], - "cpu_min_frequency_GHz": [
- "2.5"
], - "cpu_max_frequency_GHz": [
- "3.5"
], - "has_local_disk": true,
- "local_disk_size_GB": 150,
- "local_num_of_disks": 1,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.27
}, - "machine_volume_conf": null
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}, - "tenant_id": "a6a9c5ea-57b6-4a1c-aa99-84645f675b62",
- "created_by": {
- "user_id": 4,
- "username": "ya0000@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-04-28T14:55:32.795+00:00",
- "from_date": "2024-04-19T15:20:49.734293+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 2,
- "total_pages": 2,
- "limit": 1,
- "next_page": 2
}
}
Search cluster instance based on name.
Retrieve a list of cluster instances based on the name search.
Authorizations:
query Parameters
cluster_name required | string Cluster instance name used for filtering. |
cluster_status | Array of strings Items Enum: "INITIATING" "RUNNING" "STOPPING" "STOPPED" "DESTROYING" "DESTROYED" "ERROR" "RESIZING_UP" "RESIZING_DOWN" Specifies the cluster instance statuses to be used as a filter. |
cluster_conf_id | integer <int64> Cluster configuration ID used for filtering. |
cluster_conf_name | string Cluster configuration name used for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "cluster_id": 21,
- "name": "test-cluster",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "total_ycu": 597.237,
- "cloud_env": {
- "cloud_env_id": 1,
- "name": "aws_load_test_cloud_env",
- "cloud_provider": {
- "cloud_provider_id": 1,
- "name": "AWS"
}
}, - "cluster_conf": {
- "cluster_conf_id": 156,
- "cluster_conf_name": "m5dn.xlarge",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 99,
- "name": "m5dn.xlarge",
- "vCPUs": 4,
- "memory": "16 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Platinum 8259"
], - "cpu_min_frequency_GHz": [
- "2.5"
], - "cpu_max_frequency_GHz": [
- "3.5"
], - "has_local_disk": true,
- "local_disk_size_GB": 150,
- "local_num_of_disks": 1,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.27
}, - "machine_volume_conf": null
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}, - "tenant_id": "a6a9c5ea-57b6-4a1c-aa99-84645f675b62",
- "created_by": {
- "user_id": 4,
- "username": "ya0000@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-04-28T14:55:32.795+00:00",
- "from_date": "2024-04-19T15:20:49.734293+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 2,
- "total_pages": 2,
- "limit": 1,
- "next_page": 2
}
}
Calculate Spark driver memory.
Calculates the Spark driver memory based on provided machine memory and the maximum parallel Spark job execution per instance.
Authorizations:
query Parameters
machine_memory required | integer <int64> Total machine memory in GB |
max_parallel_spark_job_execution_per_instance required | integer <int64> Maximum parallel Spark job execution per instance |
Responses
Response samples
- 200
- 400
- 401
- 404
- 409
- 500
{- "message": "For each job 1G of Spark driver memory will be allocated."
}
Create a new cluster instance.
Create a new cluster instance with provided configuration.
Authorizations:
Request Body schema: application/jsonrequired
Cluster instance configuration to be added.
name required | string non-empty The
|
description | string or null non-empty |
idle_timeout_ms | integer <int64> |
auto_shutdown | boolean Default: true |
labels | object |
is_spot_instance required | boolean |
enable_public_ip required | boolean |
block_project_ssh_keys required | boolean Default: false |
bootstrap_shell_script | string or null non-empty |
cloud_env_id required | integer <int64> |
object_storage_manager_id required | integer <int64> |
cluster_conf_id required | integer <int64> |
object | |
hive_metastore_conf_id | integer or null <int64> |
spark_infra_version_id required | integer <int64> |
object | |
cluster_type required | string Enum: "YEEDU" "STANDALONE" "CLUSTER" |
min_instances required | integer <int64> >= 1 Default: 1 |
max_instances required | integer <int64> <= 30 |
Responses
Request samples
- Payload
{- "name": "yeedu_instance",
- "description": "Test yeedu instance",
- "idle_timeout_ms": 1200000,
- "auto_shutdown": true,
- "labels": {
- "resource": "yeedu"
}, - "is_spot_instance": false,
- "enable_public_ip": false,
- "block_project_ssh_keys": false,
- "cloud_env_id": 1,
- "object_storage_manager_id": 1,
- "cluster_conf_id": 1,
- "spark_infra_version_id": 0,
- "spark_config": {
- "conf": [
- "key1 value1",
- "key2 value2"
], - "packages": [
- "string"
], - "repositories": [
- "string"
], - "jars": [
- "string"
], - "archives": [
- "string"
], - "env_var": [
- "key1=value1",
- "key2=value2"
], - "files": [
- "string"
], - "py-files": [
- "string"
], - "conf_secret": {
- "key": "value"
}, - "env_var_secret": {
- "key": "value"
}
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5
}, - "cluster_type": "YEEDU",
- "min_instances": 1,
- "max_instances": 3
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "cluster_id": "1",
- "instance_name": "yeedu_instance",
- "idle_timeout_ms": "300000",
- "auto_shutdown": true,
- "cloud_env_id": "1",
- "cluster_conf_id": "1",
- "tenant_id": "d9d98a22-5216-4955-b3d9-b0337d8ac0d9",
- "created_by_user_id": "4",
- "modified_by_user_id": "4",
- "last_update_date": "2023-03-17T10:56:15.184Z",
- "from_date": "2023-03-17T10:56:15.184Z",
- "to_date": null
}
Get details of a specific cluster instance.
Retrieve cluster instance details filtered by ID or name.
Authorizations:
query Parameters
cluster_id | integer <int64> Cluster instance ID used for filtering. |
cluster_name | string Cluster instance name used for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "cluster_id": 21,
- "name": "test-cluster",
- "description": "Created for jobs load test",
- "labels": {
- "resource": "yeedu",
- "vm": "yeedu_node",
- "tenant_id": "a6a9c5ea-57b6-4a1c-aa99-84645f675b62"
}, - "idle_timeout_ms": 1800000,
- "auto_shutdown": false,
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "is_spot_instance": false,
- "enable_public_ip": false,
- "block_project_ssh_keys": false,
- "min_instances": 1,
- "max_instances": 1,
- "total_ycu": 597.237,
- "bootstrap_shell_script": "#!/bin/bash\n \necho \"10.10.30.196 test.yeedu.com\" >> /etc/hosts\n",
- "cluster_conf": {
- "cluster_conf_id": 156,
- "cluster_conf_name": "m5dn.xlarge",
- "description": null,
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 99,
- "name": "m5dn.xlarge",
- "vCPUs": 4,
- "memory": "16 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Platinum 8259"
], - "cpu_min_frequency_GHz": [
- "2.5"
], - "cpu_max_frequency_GHz": [
- "3.5"
], - "has_local_disk": true,
- "local_disk_size_GB": 150,
- "local_num_of_disks": 1,
- "local_disk_bus_type": {
- "local_disk_bus_type_id": 1,
- "local_disk_bus_type": "NVME"
}, - "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.27
}, - "machine_volume_conf": null
}, - "cloud_env": {
- "cloud_env_id": 1,
- "name": "aws_load_test_cloud_env",
- "description": "",
- "cloud_provider": {
- "cloud_provider_id": 1,
- "name": "AWS",
- "description": "Provider for creating infrastructure on Amazon Web Services"
}, - "availabilty_zone": {
- "availabilty_zone_id": 103,
- "name": "us-east-2",
- "cloud_provider_id": 1,
- "region": "us-east-2",
- "description": "Ohio, US East"
}, - "machine_network": {
- "machine_network_conf_id": 1,
- "name": "aws_network",
- "description": "creating gcp network config",
- "network_project_id": "7986-5432-1098",
- "network_name": "eni-7986d54edd3c2fe1f",
- "network_tags": [
- "sg-0ca79acefcfd865fa"
], - "subnet": "subnet-9d87654a32105d42d",
- "machine_network_availability_zone": {
- "availability_zone_id": 103,
- "name": "us-east-2",
- "cloud_provider_id": 1,
- "region": "us-east-2",
- "description": "Ohio, US East"
}
}, - "cloud_project": "798654321098",
- "credentials_config": {
- "credential_config_id": 1,
- "name": "aws_genomic_security",
- "description": null,
- "credential_type": {
- "credential_type_id": 1,
- "name": "AWS Access Secret Key Pair",
- "cloud_provider_id": 1
}
}, - "boot_disk_image": {
- "boot_disk_image_id": 3,
- "name": "aws_ubuntu",
- "description": "Base image for AWS Ubuntu",
- "cloud_provider_id": 1,
- "linux_distro": {
- "linux_distro_id": 0,
- "distro_name": "UBUNTU",
- "distro_version": "20.04 LTS"
}, - "boot_disk_image": "ami-9d87654a32105d42d"
}
}, - "hive_metastore_conf": {
- "hive_metastore_conf_id": null,
- "hive_metastore_conf_name": null
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "spark_config": {
- "conf": [ ],
- "packages": [ ],
- "repositories": [ ],
- "jars": [ ],
- "archives": [ ],
- "env_var": [ ],
- "conf_secret": null,
- "env_var_secret": null,
- "files": [ ],
- "py-files": [ ]
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}, - "object_storage_manager": {
- "object_storage_manager_id": 23,
- "name": "jobs-osm",
- "description": "jobs",
- "credentials_config": {
- "credential_config_id": 1,
- "name": "aws_genomic_security",
- "description": null,
- "credential_type_name": "AWS Access Secret Key Pair"
}, - "object_storage_bucket_name": "yeedu"
}, - "workflow_job_instance_details": {
- "workflow_job_instance_status": {
- "workflow_job_instance_id": 850897,
- "workflow_job_id": 850897,
- "status": "DONE",
- "from_date": "2024-04-29T08:43:27.119079+00:00",
- "to_date": "2024-04-29T08:44:01.959592+00:00"
}
}, - "tenant_id": "a6a9c5ea-57b6-4a1c-aa99-84645f675b62",
- "created_by": {
- "user_id": 4,
- "username": "ya0000@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000@yeedu.io"
}, - "last_update_date": "2024-04-28T14:55:32.795+00:00",
- "from_date": "2024-04-19T15:20:49.734293+00:00",
- "to_date": "infinity"
}
Update details of a specific cluster instance.
The following parameters are permitted for editing in different cluster states:
In all cluster states:
- name
- description
- idle_timeout_ms
- auto_shutdown
Only when the cluster is in a STOPPED state:
- labels
- block_project_ssh_keys
- enable_public_ip
- bootstrap_shell_script
- cloud_env_id
- object_storage_manager_id
- hive_metastore_conf_id
- cluster_conf_id
- spark_infra_version_id
- engine_cluster_spark_config:
- max_parallel_spark_job_execution_per_instance
- standalone_worker_numbers
- spark_config:
- conf
- packages
- repositories
- jars
- archives
- env_var
- conf_secret
- env_var_secret
- files
- "py-files"
- min_instances
- max_instances
Authorizations:
query Parameters
cluster_id | integer <int64> Cluster instance ID used for modification. |
cluster_name | string Cluster instance name used for modification. |
Request Body schema: application/jsonrequired
Cluster instance details to be modified.
name | string non-empty The
|
description | string or null non-empty |
idle_timeout_ms | integer <int64> |
auto_shutdown | boolean |
labels | object |
enable_public_ip | boolean |
block_project_ssh_keys | boolean |
bootstrap_shell_script | string or null non-empty |
cloud_env_id | integer <int64> |
cluster_conf_id | integer <int64> |
object_storage_manager_id | integer <int64> |
object | |
hive_metastore_conf_id | integer or null <int64> |
spark_infra_version_id | integer <int64> |
object | |
min_instances | integer <int64> >= 1 |
max_instances | integer <int64> <= 30 |
Responses
Request samples
- Payload
{- "name": "yeedu_instance",
- "description": "Test yeedu instance",
- "idle_timeout_ms": 1200000,
- "auto_shutdown": true,
- "labels": {
- "resource": "yeedu"
}, - "enable_public_ip": false,
- "block_project_ssh_keys": false,
- "cloud_env_id": 1,
- "object_storage_manager_id": 1,
- "cluster_conf_id": 1,
- "spark_infra_version_id": 1,
- "spark_config": {
- "conf": [
- "key1 value1",
- "key2 value2"
], - "packages": [
- "string"
], - "repositories": [
- "string"
], - "jars": [
- "string"
], - "archives": [
- "string"
], - "env_var": [
- "key1=value1",
- "key2=value2"
], - "conf_secret": {
- "key": "value"
}, - "env_var_secret": {
- "key": "value"
}, - "files": [
- "string"
], - "py-files": [
- "string"
]
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5
}, - "min_instances": 1,
- "max_instances": 3
}
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "cluster_id": "1",
- "instance_name": "yeedu_instance",
- "idle_timeout_ms": "300000",
- "auto_shutdown": true,
- "cloud_env_id": "1",
- "cluster_conf_id": "1",
- "tenant_id": "d9d98a22-5216-4955-b3d9-b0337d8ac0d9",
- "created_by_user_id": "4",
- "modified_by_user_id": "4",
- "last_update_date": "2023-03-17T10:56:15.184Z",
- "from_date": "2023-03-17T10:56:15.184Z",
- "to_date": null
}
Start a cluster instance.
Start a cluster instance by ID or name. Only cluster instances in the STOPPED state can be started.
Authorizations:
Request Body schema: application/jsonrequired
Cluster instance to be started.
cluster_id | integer <int64> |
cluster_name | string non-empty |
Responses
Request samples
- Payload
{- "cluster_id": 1
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "CosiStart": {
- "workflow_job_id": "1",
- "workflow_job_instance_id": "1",
- "engine_cluster_instance_id": "1"
}
}
Stop a cluster instance.
Stop a cluster instance by ID or name. Only cluster instances in the RUNNING state can be stopped.
Authorizations:
Request Body schema: application/jsonrequired
Cluster instance to be stopped.
cluster_id | integer <int64> |
cluster_name | string non-empty |
Responses
Request samples
- Payload
{- "cluster_id": 1
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "CosiStop": {
- "workflow_job_id": "1",
- "workflow_job_instance_id": "1",
- "engine_cluster_instance_id": 1
}
}
Destroy a cluster instance.
Destroy a cluster instance by ID or name. Only cluster instances in the RUNNING, STOPPED, or ERROR states can be destroyed.
Authorizations:
Request Body schema: application/jsonrequired
Cluster instance to be destroyed.
cluster_id | integer <int64> |
cluster_name | string non-empty |
Responses
Request samples
- Payload
{- "cluster_id": 1
}
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "CosiDestroy": {
- "workflow_job_id": 1,
- "workflow_job_instance_id": 1,
- "engine_cluster_instance_id": 1
}
}
Get all the cluster instance states.
Retrieve a list of cluster instance events (states) filtered by ID or name.
Authorizations:
query Parameters
cluster_id | integer <int64> Cluster instance ID used for filtering. |
cluster_name | string Cluster instance name used for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "cluster_status_id": 1143,
- "cluster_status": "RUNNING",
- "current_node_size": 1,
- "created_by": null,
- "start_time": "2024-04-29T08:44:01.959592+00:00",
- "end_time": "infinity"
}, - {
- "cluster_status_id": 1141,
- "cluster_status": "INITIATING",
- "current_node_size": 1,
- "created_by": null,
- "start_time": "2024-04-29T08:43:27.119079+00:00",
- "end_time": "2024-04-29T08:44:01.959592+00:00"
}, - {
- "cluster_status_id": 1139,
- "cluster_status": "STOPPED",
- "current_node_size": 0,
- "created_by": null,
- "start_time": "2024-04-29T07:14:31.59839+00:00",
- "end_time": "2024-04-29T08:43:27.119079+00:00"
}, - {
- "cluster_status_id": 1138,
- "cluster_status": "STOPPING",
- "current_node_size": 0,
- "created_by": "ysu0000@yeedu.io",
- "start_time": "2024-04-29T07:12:58.081903+00:00",
- "end_time": "2024-04-29T07:14:31.59839+00:00"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 34,
- "total_pages": 9,
- "limit": 4,
- "next_page": 2
}
}
Get cluster instance logs.
Download cluster instance logs filtered by ID or name.
Authorizations:
path Parameters
log_type required | string Enum: "stdout" "stderr" The type of log file to filter. |
query Parameters
cluster_id | integer <int64> Cluster instance ID used for filtering. |
cluster_name | string Cluster instance name used for filtering. |
cluster_status_id | integer <int64> Cluster status ID used for filtering. |
Responses
Response samples
- 400
- 401
- 404
- 500
{- "error_code": "string",
- "error_message": "string"
}
Get Spark job statistics of a cluster instance.
Retrieve Spark job statistics for a specific cluster instance by its ID or Name.
Authorizations:
query Parameters
cluster_id | integer <int64> Cluster instance ID used for filtering. |
cluster_name | string Cluster instance name used for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "SUBMITTED": 0,
- "RUNNING": 0,
- "DONE": 511607,
- "ERROR": 0,
- "TERMINATED": 0,
- "STOPPING": 0,
- "STOPPED": 0,
- "TOTAL_JOB_COUNT": 511607
}
Get workflow errors of a cluster instance.
Retrieve a list of workflow errors for a specific cluster instance by its ID.
Authorizations:
path Parameters
cluster_id required | integer <int64> Cluster instance ID used for filtering. |
query Parameters
cluster_status_id | integer <int64> Cluster status ID used for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "error": "OnError(Process finish with exit code 137,None,None,None,Some(akka.stream.alpakka.amqp.impl.AmqpSourceStage$$anon$1$$anon$2$$anon$3@47b8c55f))"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 10
}
}
Stop all jobs in a cluster instance.
Stops all jobs in a specific cluster that are in the SUBMITTED or RUNNING state.
Authorizations:
path Parameters
cluster_id required | integer <int64> Specifies the ID of the cluster instance to stop all the jobs. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "CosiKillAllJobsByCluster": {
- "workflow_job_id": 0,
- "workflow_job_instance_id": 0,
- "engine_cluster_instance_id": 1,
- "created_by_user_id": 1
}
}
Get Workspaces for a specific Cluster Id
Retrieve a list of workspaces filtered by a specific Cluster Id
Authorizations:
path Parameters
cluster_id required | integer <int64> Cluster ID used for filtering. |
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "workspace": {
- "workspace_id": 5,
- "name": "test",
- "description": null
}, - "cluster_info": {
- "cluster_id": 13,
- "name": "gcp_test",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "cluster_conf": {
- "cluster_conf_id": 10,
- "cluster_conf_name": "n1-standard-4",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 10,
- "name": "n1-standard-4",
- "vCPUs": 4,
- "memory": "15 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Scalable (Skylake) 1st Generation",
- "Intel Xeon E5 v4 (Broadwell E5)",
- "Intel Xeon E5 v3 (Haswell)",
- "Intel Xeon E5 v2 (Ivy Bridge)",
- "Intel Xeon E5 (Sandy Bridge)"
], - "cpu_min_frequency_GHz": [
- "2.0",
- "2.2",
- "2.3",
- "2.5",
- "2.6"
], - "cpu_max_frequency_GHz": [
- "3.5",
- "3.7",
- "3.8",
- "3.5",
- "3.6"
], - "has_local_disk": false,
- "local_disk_size_GB": null,
- "local_num_of_disks": null,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.5
}, - "machine_volume_conf": {
- "volume_conf_id": 2,
- "name": "volume_gcp_2",
- "size": 375,
- "machine_volume_num": 2,
- "machine_volume_strip_num": 2
}
}, - "cloud_env": {
- "cloud_env_id": 11,
- "name": "test",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP"
}
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}
}, - "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-20T17:21:01.800375+00:00",
- "from_date": "2024-06-20T17:21:01.800375+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 1
}
}
Search Workspaces for a specific Cluster Id and Workspace Name
Search workspaces for a specific Cluster Id and Workspace Name, returned in the form of JSON
Authorizations:
path Parameters
cluster_id required | integer <int64> Cluster Id that will be used for filter |
query Parameters
workspace_name required | string Workspace Name that will be used for filter |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "workspace": {
- "workspace_id": 5,
- "name": "test",
- "description": null
}, - "cluster_info": {
- "cluster_id": 13,
- "name": "gcp_test",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "cluster_conf": {
- "cluster_conf_id": 10,
- "cluster_conf_name": "n1-standard-4",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 10,
- "name": "n1-standard-4",
- "vCPUs": 4,
- "memory": "15 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Scalable (Skylake) 1st Generation",
- "Intel Xeon E5 v4 (Broadwell E5)",
- "Intel Xeon E5 v3 (Haswell)",
- "Intel Xeon E5 v2 (Ivy Bridge)",
- "Intel Xeon E5 (Sandy Bridge)"
], - "cpu_min_frequency_GHz": [
- "2.0",
- "2.2",
- "2.3",
- "2.5",
- "2.6"
], - "cpu_max_frequency_GHz": [
- "3.5",
- "3.7",
- "3.8",
- "3.5",
- "3.6"
], - "has_local_disk": false,
- "local_disk_size_GB": null,
- "local_num_of_disks": null,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.5
}, - "machine_volume_conf": {
- "volume_conf_id": 2,
- "name": "volume_gcp_2",
- "size": 375,
- "machine_volume_num": 2,
- "machine_volume_strip_num": 2
}
}, - "cloud_env": {
- "cloud_env_id": 11,
- "name": "test",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP"
}
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}
}, - "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-20T17:21:01.800375+00:00",
- "from_date": "2024-06-20T17:21:01.800375+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 1
}
}
Get Clusters for a specific Workspace Id
Clusters are filtered for a specific Workspace Id and returned in the form of JSON
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
cluster_status | Array of strings Items Enum: "INITIATING" "RUNNING" "STOPPING" "STOPPED" "DESTROYING" "DESTROYED" "ERROR" "RESIZING_UP" "RESIZING_DOWN" Specifies the cluster instance statuses to be used as a filter. |
job_type | string Enum: "SPARK_JOB" "SPARK_SQL" "NOTEBOOK" Specifies the job type to filter and list the supported clusters. |
all | boolean Default: false Enum: true false A boolean that can be set to return all the data. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "workspace": {
- "workspace_id": 5,
- "name": "test",
- "description": null
}, - "cluster_info": {
- "cluster_id": 13,
- "name": "gcp_test",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "cluster_conf": {
- "cluster_conf_id": 10,
- "cluster_conf_name": "n1-standard-4",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 10,
- "name": "n1-standard-4",
- "vCPUs": 4,
- "memory": "15 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Scalable (Skylake) 1st Generation",
- "Intel Xeon E5 v4 (Broadwell E5)",
- "Intel Xeon E5 v3 (Haswell)",
- "Intel Xeon E5 v2 (Ivy Bridge)",
- "Intel Xeon E5 (Sandy Bridge)"
], - "cpu_min_frequency_GHz": [
- "2.0",
- "2.2",
- "2.3",
- "2.5",
- "2.6"
], - "cpu_max_frequency_GHz": [
- "3.5",
- "3.7",
- "3.8",
- "3.5",
- "3.6"
], - "has_local_disk": false,
- "local_disk_size_GB": null,
- "local_num_of_disks": null,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.5
}, - "machine_volume_conf": {
- "volume_conf_id": 2,
- "name": "volume_gcp_2",
- "size": 375,
- "machine_volume_num": 2,
- "machine_volume_strip_num": 2
}
}, - "cloud_env": {
- "cloud_env_id": 11,
- "name": "test",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP"
}
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}
}, - "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-20T17:21:01.800375+00:00",
- "from_date": "2024-06-20T17:21:01.800375+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 1
}
}
Search clusters by cluster name in a specific workspace
Clusters are filtered based on a specific cluster name within a Workspace ID, and the results are returned as a JSON
Authorizations:
path Parameters
workspace_id required | integer <int64> Workspace Id that will be used for filter |
query Parameters
cluster_name required | string Cluster Name that will be used for filter |
cluster_status | Array of strings Items Enum: "INITIATING" "RUNNING" "STOPPING" "STOPPED" "DESTROYING" "DESTROYED" "ERROR" "RESIZING_UP" "RESIZING_DOWN" Specifies the cluster instance statuses to be used as a filter. |
job_type | string Enum: "SPARK_JOB" "SPARK_SQL" "NOTEBOOK" Specifies the job type to filter and search the supported clusters. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "workspace": {
- "workspace_id": 5,
- "name": "test",
- "description": null
}, - "cluster_info": {
- "cluster_id": 13,
- "name": "gcp_test",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "cluster_conf": {
- "cluster_conf_id": 10,
- "cluster_conf_name": "n1-standard-4",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 10,
- "name": "n1-standard-4",
- "vCPUs": 4,
- "memory": "15 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Scalable (Skylake) 1st Generation",
- "Intel Xeon E5 v4 (Broadwell E5)",
- "Intel Xeon E5 v3 (Haswell)",
- "Intel Xeon E5 v2 (Ivy Bridge)",
- "Intel Xeon E5 (Sandy Bridge)"
], - "cpu_min_frequency_GHz": [
- "2.0",
- "2.2",
- "2.3",
- "2.5",
- "2.6"
], - "cpu_max_frequency_GHz": [
- "3.5",
- "3.7",
- "3.8",
- "3.5",
- "3.6"
], - "has_local_disk": false,
- "local_disk_size_GB": null,
- "local_num_of_disks": null,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.5
}, - "machine_volume_conf": {
- "volume_conf_id": 2,
- "name": "volume_gcp_2",
- "size": 375,
- "machine_volume_num": 2,
- "machine_volume_strip_num": 2
}
}, - "cloud_env": {
- "cloud_env_id": 11,
- "name": "test",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP"
}
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}
}, - "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-20T17:21:01.800375+00:00",
- "from_date": "2024-06-20T17:21:01.800375+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 1
}
}
Map a Cluster with a Workspace
Map a Cluster with a workspace
Authorizations:
path Parameters
workspace_id required | integer <int64> Workspace Id that will be used for filter |
cluster_id required | integer <int64> Cluster Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "workspace_id": "5",
- "cluster_id": "13",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T11:20:59.259Z",
- "from_date": "2024-06-21T11:20:59.259Z",
- "to_date": null
}
Delete an existing Cluster Permission for a Group
Authorizations:
path Parameters
cluster_id required | integer <int64> Cluster Id that will be used for filter |
workspace_id required | integer <int64> Workspace Id that will be used for filter |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "Deleted Permission Successfully."
}
Get all the workspaces.
All workspaces within the tenant will be listed for users with either a
Platform Admin
orAdmin
role.For users with a
Can Manage Cluster
orUser
role, only the workspaces where they have at least one workspace permission will be listed.
Authorizations:
query Parameters
enable | boolean Enum: true false Specifies which workspace to list.
Note: If unspecified, all workspaces (both active and disabled) will be listed. |
cluster_id | integer <int64> Filter workspaces by |
is_attached | boolean Enum: true false Filter workspaces by cluster attachment status. Requires both |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "workspace_id": 5,
- "name": "test",
- "job_conf_count": 4,
- "notebook_conf_count": 2,
- "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "last_update_date": "2024-06-20T17:20:46.149683+00:00",
- "from_date": "2024-06-20T17:20:46.149683+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 1
}
}
Search workspaces based on workspace name.
All workspaces within the tenant can be searched by users with either a
Platform Admin
orAdmin
role.For users with a
Can Manage Cluster
orUser
role, only the workspaces where they have at least one workspace permission can be searched.
Authorizations:
query Parameters
workspace_name required | string Specifies the name of the workspace to search. |
enable | boolean Enum: true false Specifies which workspace to search.
Note: If unspecified, all workspaces (both active and disabled) will be searched. |
cluster_id | integer <int64> Filter workspaces by |
is_attached | boolean Enum: true false Filter workspaces by cluster attachment status. Requires both |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "workspace_id": 5,
- "name": "test",
- "job_conf_count": 4,
- "notebook_conf_count": 2,
- "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "last_update_date": "2024-06-20T17:20:46.149683+00:00",
- "from_date": "2024-06-20T17:20:46.149683+00:00",
- "to_date": "infinity"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 1
}
}
Create a new Workspace
Creates a new workspace with the provided workspace details.
Authorizations:
Request Body schema: application/jsonrequired
The Workspace details to be added
name required | string non-empty The
|
description | string or null non-empty |
Responses
Request samples
- Payload
{- "name": "test_workspace",
- "description": "Workspace for test environment"
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "workspace_id": "6",
- "name": "spark_jobs_test",
- "description": "Test Spark Jobs",
- "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T11:29:36.685Z",
- "from_date": "2024-06-21T11:29:36.685Z",
- "to_date": null
}
Get details of a specific workspace.
Workspace details within the tenant can be retrieved by users with either a
Platform Admin
orAdmin
role.For users with a
Can Manage Cluster
orUser
role, only the workspace details where they have at least one workspace permission can be retrieved.
Authorizations:
query Parameters
workspace_id | integer <int64> Specifies the ID of the workspace to retrieve details. |
workspace_name | string Specifies the name of the workspace to retrieve details. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "workspace_id": 6,
- "name": "spark_jobs_test",
- "description": "Test Spark Jobs",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "last_update_date": "2024-06-21T11:29:36.685681+00:00",
- "from_date": "2024-06-21T11:29:36.685681+00:00",
- "to_date": "infinity"
}
Update details of a specific workspace.
All workspaces within the tenant can be modified by users with either a
Platform Admin
orAdmin
role.For users with a
Can Manage Cluster
orUser
role, only the workspaces where they have at least one workspace permission can be modified.
Authorizations:
query Parameters
workspace_id | integer <int64> Specifies the ID of the workspace to update details. |
workspace_name | string Specifies the name of the workspace to update details. |
Request Body schema: application/jsonrequired
The Workspace details to be modified
name | string non-empty The
|
description | string or null non-empty |
Responses
Request samples
- Payload
{- "name": "spark_jobs_test",
- "description": "Test Spark Curation Jobs"
}
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "workspace_id": "6",
- "name": "spark_jobs_test",
- "description": "Test Spark Jobs",
- "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T11:29:36.685Z",
- "from_date": "2024-06-21T11:29:36.685Z",
- "to_date": null
}
Enable a specific workspace.
All workspaces within the tenant can be enabled by users with either a
Platform Admin
orAdmin
role.For users with a
Can Manage Cluster
orUser
role, only the workspaces where they have at least one workspace permission can be enabled.
Authorizations:
query Parameters
workspace_id | integer <int64> Workspace Id that will be used for filter |
workspace_name | string Workspace Name that will be used for filter |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "workspace_id": "6",
- "name": "spark_jobs_test",
- "description": "Test Spark Jobs",
- "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T11:29:36.685Z",
- "from_date": "2024-06-21T11:29:36.685Z",
- "to_date": null
}
Disable a specific workspace.
All workspaces within the tenant can be disabled by users with either a
Platform Admin
orAdmin
role.For users with a
Can Manage Cluster
orUser
role, only the workspaces where they have at least one workspace permission can be disabled.
Authorizations:
query Parameters
workspace_id | integer <int64> Workspace Id that will be used for filter |
workspace_name | string Workspace Name that will be used for filter |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "workspace_id": "6",
- "name": "spark_jobs_test",
- "description": "Test Spark Curation Jobs",
- "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T11:35:38.174Z",
- "from_date": "2024-06-21T11:29:36.685Z",
- "to_date": "2024-06-21T11:35:38.174Z"
}
Get Spark job statistics of a workspace.
Retrieve Spark job statistics for a specific workspace by its ID or Name.
Workspace statistics within the tenant can be retrieved by users with either a
Platform Admin
orAdmin
role.For users with a
Can Manage Cluster
orUser
role, only the workspace statistics where they have at least one workspace permission can be retrieved.
Authorizations:
query Parameters
workspace_id | integer <int64> Specifies the ID of the workspace to retrieve stats. |
workspace_name | string Specifies the name of the workspace to retrieve stats. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "SUBMITTED": 0,
- "RUNNING": 0,
- "DONE": 511607,
- "ERROR": 0,
- "TERMINATED": 0,
- "STOPPING": 0,
- "STOPPED": 0,
- "TOTAL_JOB_COUNT": 511607
}
Get all users having a specific permission in a workspace.
Users having a specific permission in a workspace are listed by workspace ID and permission ID.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace to retrieve users from. |
permission_id required | integer <int64> Specifies the ID of the permission to retrieve users. |
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": {
- "workspace_id": 1,
- "workspace_name": "test-workspace",
- "description": null,
- "permission": {
- "permission_id": 1,
- "name": "RUN",
- "description": "To list and run the jobs within a workspace",
- "users": [
- {
- "user_id": 12,
- "username": "ru0001-yeedu@yeedu.io",
- "display_name": "RU0001",
- "email": null
}
]
}
}, - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 100
}
}
Get workspace users for a specific Workspace ID.
Workspace users are filtered for a specific Workspace ID and Group ID.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
group_id | integer <int64> Specifies the ID of the group for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": {
- "workspace_id": 1,
- "workspace_name": "test-workspace",
- "description": null,
- "permission": {
- "permission_id": 1,
- "name": "RUN",
- "description": "To list and run the jobs within a workspace",
- "users": [
- {
- "user_id": 12,
- "username": "ru0001-yeedu@yeedu.io",
- "display_name": "RU0001",
- "email": null
}
]
}
}, - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 100
}
}
Search workspace users by Workspace ID and Username.
Search workspace users by a specific Workspace ID and Username.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
username required | string Specifies the username for searching. |
group_id | integer <int64> Specifies the ID of the group for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": {
- "workspace_id": 1,
- "workspace_name": "test-workspace",
- "description": null,
- "permission": {
- "permission_id": 1,
- "name": "RUN",
- "description": "To list and run the jobs within a workspace",
- "users": [
- {
- "user_id": 12,
- "username": "ru0001-yeedu@yeedu.io",
- "display_name": "RU0001",
- "email": null
}
]
}
}, - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 100
}
}
Match username for a specific Workspace ID.
Match username for a specific Workspace ID.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
username required | string Specifies the username to get an exact match. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "user_id": 12,
- "username": "ru0001-yeedu@yeedu.io",
- "display_name": "RU0001",
- "email": "ru0001-yeedu@yeedu.io",
- "from_date": "2024-06-20T10:38:48.746144+00:00",
- "to_date": "infinity"
}
Get user's workspace permission.
Retrieve workspace permission of a user by a specific Workspace ID and User ID.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
user_id required | integer <int64> Specifies the ID of the user for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "user_id": "12",
- "username": "ru0001-yeedu@yeedu.io",
- "workspace": {
- "workspace_id": "1",
- "name": "test-workspace",
- "description": null
}, - "tenant_id": "9d6d3054-a5f6-4dbf-86f9-26989eb73ed3",
- "user_permission": {
- "auth_workspace_user_id": 17,
- "permission": {
- "auth_workspace_perm_id": 1,
- "name": "RUN",
- "description": "To list and run the jobs within a workspace"
}, - "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-20T11:17:23.25889+00:00",
- "from_date": "2024-06-20T11:17:23.25889+00:00",
- "to_date": "infinity"
}, - "group_permission": null
}
Get all groups having a specific permission in a workspace.
Groups having a specific permission in a workspace are listed by workspace ID and permission ID.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace to retrieve groups from. |
permission_id required | integer <int64> Specifies the ID of the permission to retrieve groups. |
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": {
- "workspace_id": 3,
- "workspace_name": "stats_test_workspace",
- "description": null,
- "permission": {
- "permission_id": 3,
- "name": "MANAGE",
- "description": "To list jobs, run jobs, edit Spark job configurations, and manage workspace access by adding or removing permissions",
- "groups": [
- {
- "group_id": 75,
- "group_name": "G_Yeedu_Analyst",
- "group_mail": null,
- "group_object_id": "98b270e4-42fd-4969-8884-25a2e8384e53",
- "group_type": null
}
]
}
}, - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 100
}
}
Get workspace groups for a specific Workspace ID.
Workspace groups are filtered for a specific Workspace ID and User ID.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
user_id | integer <int64> Specifies the ID of the user for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": {
- "workspace_id": 3,
- "workspace_name": "stats_test_workspace",
- "description": null,
- "permission": {
- "permission_id": 3,
- "name": "MANAGE",
- "description": "To list jobs, run jobs, edit Spark job configurations, and manage workspace access by adding or removing permissions",
- "groups": [
- {
- "group_id": 75,
- "group_name": "G_Yeedu_Analyst",
- "group_mail": null,
- "group_object_id": "98b270e4-42fd-4969-8884-25a2e8384e53",
- "group_type": null
}
]
}
}, - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 100
}
}
Search workspace groups by Workspace ID and Group name.
Search workspace groups by a specific Workspace ID and Username.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
groupname required | string Specifies the group name for searching. |
user_id | integer <int64> Specifies the ID of the user for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": {
- "workspace_id": 3,
- "workspace_name": "stats_test_workspace",
- "description": null,
- "permission": {
- "permission_id": 3,
- "name": "MANAGE",
- "description": "To list jobs, run jobs, edit Spark job configurations, and manage workspace access by adding or removing permissions",
- "groups": [
- {
- "group_id": 75,
- "group_name": "G_Yeedu_Analyst",
- "group_mail": null,
- "group_object_id": "98b270e4-42fd-4969-8884-25a2e8384e53",
- "group_type": null
}
]
}
}, - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 100
}
}
Match groupname for a specific Workspace ID.
Match groupname for a specific Workspace ID.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
groupname required | string Specifies the group name to get an exact match. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "group_id": 602,
- "group_name": "G_Yeedu_Auditor",
- "group_object_id": "ba7d4601-57-a055-953d800",
- "group_type": null,
- "from_date": "2024-06-20T11:25:39.573594+00:00",
- "to_date": "infinity"
}
]
Get group's workspace permission.
Retrieve workspace permission of a group by a specific Workspace ID and group ID.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
group_id required | integer <int64> Specifies the ID of the group for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "group_id": "75",
- "group_name": "G_Yeedu_Analyst",
- "workspace": {
- "workspace_id": "3",
- "name": "stats_test_workspace",
- "description": null
}, - "tenant_id": "9d6d3054-a5f6-4dbf-86f9-26989eb73ed3",
- "group_permission": {
- "auth_workspace_group_id": "8",
- "permission": {
- "auth_workspace_perm_id": 3,
- "name": "MANAGE",
- "description": "To list jobs, run jobs, edit Spark job configurations, and manage workspace access by adding or removing permissions"
}, - "created_by": {
- "user_id": "1",
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": "1",
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-21T18:14:17.877Z",
- "from_date": "2024-06-21T18:14:17.877Z",
- "to_date": null
}
}
Assign a permission to a user for a specific workspace.
Provide access to a user for a workspace with a specific permission.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace where the permission will be granted. |
Request Body schema: application/jsonrequired
The workspace permission for the user to be added.
user_id required | integer <int64> |
permission_id required | integer <int64> |
Responses
Request samples
- Payload
{- "user_id": 1,
- "permission_id": 1
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "auth_workspace_user_id": "36",
- "workspace_id": "1",
- "auth_workspace_perm_id": 2,
- "user_id": "1",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T18:25:19.905Z",
- "from_date": "2024-06-21T18:25:19.905Z",
- "to_date": null
}
Assign a permission to a group for a specific workspace.
Provide access to a group for a workspace with a specific permission.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace where the permission will be granted. |
Request Body schema: application/jsonrequired
The workspace permission for the group to be added.
group_id required | integer <int64> |
permission_id required | integer <int64> |
Responses
Request samples
- Payload
{- "group_id": 1,
- "permission_id": 1
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "auth_workspace_group_id": "9",
- "workspace_id": "1",
- "auth_workspace_perm_id": 2,
- "group_id": "1",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T18:27:27.518Z",
- "from_date": "2024-06-21T18:27:27.518Z",
- "to_date": null
}
Revoke a workspace permission for a user.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace from which the permission will be revoked. |
user_id required | integer <int64> Specifies the ID of the user for whom the permission will be revoked. |
permission_id required | integer <int64> Specifies the ID of the permission to be revoked from the user. |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "Deleted Permission Successfully."
}
Revoke a workspace permission for a group.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace from which the permission will be revoked. |
group_id required | integer <int64> Specifies the ID of the group for whom the permission will be revoked. |
permission_id required | integer <int64> Specifies the ID of the permission to be revoked from the group. |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "Deleted Permission Successfully."
}
Get all Spark job configurations.
Retrieves a list of Spark job configurations.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
enable | boolean Enum: true false Specifies which Spark job configurations to list.
Note: If unspecified, all Spark job configurations (both active and disabled) will be listed. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "job_conf_id": 23,
- "name": "spark_example",
- "spark_job_type": {
- "job_type": "SPARK_JOB",
- "language": "Jar"
}, - "cluster_info": {
- "cluster_id": 13,
- "name": "gcp_test",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "cloud_env": {
- "cloud_env_id": 11,
- "name": "test",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP"
}
}, - "cluster_conf": {
- "cluster_conf_id": 10,
- "cluster_conf_name": "n1-standard-4",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 10,
- "name": "n1-standard-4",
- "vCPUs": 4,
- "memory": "15 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Scalable (Skylake) 1st Generation",
- "Intel Xeon E5 v4 (Broadwell E5)",
- "Intel Xeon E5 v3 (Haswell)",
- "Intel Xeon E5 v2 (Ivy Bridge)",
- "Intel Xeon E5 (Sandy Bridge)"
], - "cpu_min_frequency_GHz": [
- "2.0",
- "2.2",
- "2.3",
- "2.5",
- "2.6"
], - "cpu_max_frequency_GHz": [
- "3.5",
- "3.7",
- "3.8",
- "3.5",
- "3.6"
], - "has_local_disk": false,
- "local_disk_size_GB": null,
- "local_num_of_disks": null,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.5
}, - "machine_volume_conf": {
- "volume_conf_id": 2,
- "name": "volume_gcp_2",
- "size": 375,
- "machine_volume_num": 2,
- "machine_volume_strip_num": 2
}
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}
}, - "last_job_run": {
- "job_id": null,
- "job_status": null
}, - "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-20T17:24:19.782774+00:00",
- "from_date": "2024-06-20T17:24:19.782774+00:00",
- "to_date": "infinity"
}
]
}
Search Spark job configurations by configuration name.
Retrieves a list of Spark job configurations based on a search by configuration name.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
job_conf_name required | string Specifies the name of the Spark job configuration to search for. |
enable | boolean Enum: true false Specifies which Spark job configurations to search.
Note: If unspecified, all Spark job configurations (both active and disabled) will be searched. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "job_conf_id": 23,
- "name": "spark_example",
- "spark_job_type": {
- "job_type": "SPARK_JOB",
- "language": "Jar"
}, - "cluster_info": {
- "cluster_id": 13,
- "name": "gcp_test",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "cloud_env": {
- "cloud_env_id": 11,
- "name": "test",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP"
}
}, - "cluster_conf": {
- "cluster_conf_id": 10,
- "cluster_conf_name": "n1-standard-4",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 10,
- "name": "n1-standard-4",
- "vCPUs": 4,
- "memory": "15 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Scalable (Skylake) 1st Generation",
- "Intel Xeon E5 v4 (Broadwell E5)",
- "Intel Xeon E5 v3 (Haswell)",
- "Intel Xeon E5 v2 (Ivy Bridge)",
- "Intel Xeon E5 (Sandy Bridge)"
], - "cpu_min_frequency_GHz": [
- "2.0",
- "2.2",
- "2.3",
- "2.5",
- "2.6"
], - "cpu_max_frequency_GHz": [
- "3.5",
- "3.7",
- "3.8",
- "3.5",
- "3.6"
], - "has_local_disk": false,
- "local_disk_size_GB": null,
- "local_num_of_disks": null,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.5
}, - "machine_volume_conf": {
- "volume_conf_id": 2,
- "name": "volume_gcp_2",
- "size": 375,
- "machine_volume_num": 2,
- "machine_volume_strip_num": 2
}
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}
}, - "last_job_run": {
- "job_id": null,
- "job_status": null
}, - "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-20T17:24:19.782774+00:00",
- "from_date": "2024-06-20T17:24:19.782774+00:00",
- "to_date": "infinity"
}
]
}
Create a new Spark job configuration.
Creates a Spark job configuration with the provided configurations.
max_concurrency: Specifies the maximum number of concurrent Spark job instances allowed for a particular Spark job configuration.
If
max_concurrency
is set to 0, an unlimited number of Spark job instances can be submitted using the same configuration.If
max_concurrency
is greater than 0, the number of job instances that can be submitted is limited to the specifiedmax_concurrency
value.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
Request Body schema: application/jsonrequired
The Spark job configuration to be added.
cluster_id | integer <int64> |
cluster_name | string non-empty |
max_concurrency | integer <int64> Default: 0 |
name required | string non-empty The
|
files | Array of strings unique [ items non-empty ] |
properties_file | Array of strings unique [ items non-empty ] |
conf | Array of strings unique [ items non-empty ] |
packages | Array of strings unique [ items non-empty ] |
repositories | Array of strings unique [ items non-empty ] |
jars | Array of strings unique [ items non-empty ] |
archives | Array of strings unique [ items non-empty ] |
driver_memory | string or null^(?=.*[1-9])\d+(?![\d.])(?=\D) The memory cannot be negative and decimal. |
driver_java_options | string or null non-empty |
driver_library_path | string or null non-empty |
driver_class_path | string or null non-empty |
executor_memory | string or null^(?=.*[1-9])\d+(?![\d.])(?=\D) The memory cannot be negative and decimal. |
principal | string or null non-empty |
keytab | string or null non-empty |
queue | string or null non-empty |
job_class_name | string or null non-empty |
job_command | string or null non-empty |
job_arguments | string or null non-empty |
job_rawScalaCode | string or null non-empty |
job_type required | string Enum: "RAW_SCALA" "Jar" "Python3" "SQL" |
job_timeout_min | integer or null <int64> >= 1 |
extra_info | object |
driver_cores | integer or null <int32> >= 1 |
total_executor_cores | integer or null <int64> >= 1 |
executor_cores | integer or null <int32> >= 1 |
num_executors | integer or null <int32> >= 1 |
Responses
Request samples
- Payload
{- "name": "spark_examples",
- "cluster_id": "13",
- "max_concurrency": 1,
- "job_class_name": "org.apache.spark.examples.SparkPi",
- "job_command": "file:///yeedu/object-storage-manager/spark-examples_2.11-2.4.8.jar",
- "job_arguments": "500",
- "job_rawScalaCode": null,
- "job_type": "Jar",
- "job_timeout_min": null,
- "files": [
- "file:///yeedu/object-storage-manager/privateKey"
], - "properties_file": null,
- "conf": [
- "spark.sql.files.maxRecordsPerFile=1000000",
- "spark.ui.enabled=false",
- "spark.driver.yeedu_privateKey=file:///yeedu/object-storage-manager/privateKey"
], - "packages": [
- "com.github.music-of-the-ainur:almaren-framework_2.11:0.9.3-2.4",
- "org.postgresql:postgresql:42.2.8",
- "org.apache.hadoop:hadoop-aws:2.10.1",
- "org.apache.spark:spark-hive_2.11:2.4.8"
], - "repositories": null,
- "jars": [
- "file:///yeedu/object-storage-manager/gcs-connector-hadoop2-latest.jar",
- "file:///yeedu/object-storage-manager/ojdbc6-11.2.0.4.jar"
], - "archives": null,
- "driver_memory": null,
- "driver_java_options": "-Dderby.system.home=/yeedu/spark_metastores/$(date +%s)-${RANDOM}",
- "driver_library_path": null,
- "driver_class_path": null,
- "executor_memory": null,
- "driver_cores": null,
- "total_executor_cores": null,
- "executor_cores": null,
- "num_executors": null,
- "principal": null,
- "keytab": null,
- "queue": null
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "job_conf_id": "1",
- "name": "spark_examples",
- "cluster_id": "1",
- "workspace_id": "1",
- "spark_job_type_lang_id": 1,
- "max_concurrency": "1",
- "job_class_name": "org.apache.spark.examples.SparkPi",
- "job_command": "file:///yeedu/object-storage-manager/spark-examples_2.11-2.4.8.jar",
- "job_rawScalaCode": null,
- "job_arguments": "500",
- "files": [
- "file:///yeedu/object-storage-manager/privateKey"
], - "properties_file": null,
- "conf": [
- "spark.sql.files.maxRecordsPerFile=1000000",
- "spark.ui.enabled=false",
- "spark.driver.yeedu_privateKey=file:///yeedu/object-storage-manager/privateKey"
], - "packages": [
- "com.github.music-of-the-ainur:almaren-framework_2.11:0.9.3-2.4",
- "org.postgresql:postgresql:42.2.8",
- "org.apache.hadoop:hadoop-aws:2.10.1",
- "org.apache.spark:spark-hive_2.11:2.4.8"
], - "repositories": null,
- "jars": [
- "file:///yeedu/object-storage-manager/gcs-connector-hadoop2-latest.jar",
- "file:///yeedu/object-storage-manager/ojdbc6-11.2.0.4.jar"
], - "archives": null,
- "driver_memory": null,
- "driver_java_options": "-Dderby.system.home=/yeedu/spark_metastores/1666766426-8439",
- "driver_library_path": null,
- "driver_class_path": null,
- "executor_memory": null,
- "driver_cores": null,
- "total_executor_cores": null,
- "executor_cores": null,
- "num_executors": null,
- "principal": null,
- "keytab": null,
- "queue": null,
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T08:01:54.932Z",
- "from_date": "2024-06-20T17:24:19.782Z",
- "to_date": null
}
Get details of a specific Spark job configuration.
Retrieve Spark job configuration details filtered by ID or name.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
job_conf_id | integer <int64> Specifies the ID of the Spark job configuration for filtering. |
job_conf_name | string Specifies the name of the Spark job configuration for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "job_conf_id": 23,
- "name": "spark_example",
- "cluster_info": {
- "cluster_id": 13,
- "name": "gcp_test",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "cluster_conf": {
- "cluster_conf_id": 10,
- "cluster_conf_name": "n1-standard-4",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 10,
- "name": "n1-standard-4",
- "vCPUs": 4,
- "memory": "15 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Scalable (Skylake) 1st Generation",
- "Intel Xeon E5 v4 (Broadwell E5)",
- "Intel Xeon E5 v3 (Haswell)",
- "Intel Xeon E5 v2 (Ivy Bridge)",
- "Intel Xeon E5 (Sandy Bridge)"
], - "cpu_min_frequency_GHz": [
- "2.0",
- "2.2",
- "2.3",
- "2.5",
- "2.6"
], - "cpu_max_frequency_GHz": [
- "3.5",
- "3.7",
- "3.8",
- "3.5",
- "3.6"
], - "has_local_disk": false,
- "local_disk_size_GB": null,
- "local_num_of_disks": null,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.5
}, - "machine_volume_conf": {
- "volume_conf_id": 2,
- "name": "volume_gcp_2",
- "size": 375,
- "machine_volume_num": 2,
- "machine_volume_strip_num": 2
}
}, - "cloud_env": {
- "cloud_env_id": 11,
- "name": "test",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP"
}
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}
}, - "spark_job_type": {
- "job_type": "SPARK_JOB",
- "language": "Jar"
}, - "max_concurrency": 0,
- "job_class_name": "org.apache.spark.examples.SparkPi",
- "job_command": "file:///yeedu/object-storage-manager/spark-examples_2.12-3.2.2.jar",
- "job_arguments": "1000",
- "job_rawScalaCode": null,
- "job_timeout_min": null,
- "files": null,
- "properties_file": null,
- "conf": null,
- "packages": null,
- "repositories": null,
- "jars": null,
- "archives": null,
- "driver_memory": null,
- "driver_java_options": null,
- "driver_library_path": null,
- "driver_class_path": null,
- "executor_memory": null,
- "driver_cores": null,
- "total_executor_cores": null,
- "executor_cores": null,
- "num_executors": null,
- "principal": null,
- "keytab": null,
- "queue": null,
- "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-20T17:36:11.084+00:00",
- "from_date": "2024-06-20T17:24:19.782774+00:00",
- "to_date": "infinity"
}
Update details of a specific Spark job configuration.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
job_conf_id | integer <int64> Specifies the ID of the Spark job configuration for modification. |
job_conf_name | string Specifies the name of the Spark job configuration for modification. |
Request Body schema: application/jsonrequired
Spark job configuration details to be modified.
name | string non-empty The
|
cluster_id | integer <int64> |
cluster_name | string |
max_concurrency | integer <int64> |
files | Array of strings or null unique |
properties_file | Array of strings or null unique |
conf | Array of strings or null unique |
packages | Array of strings or null unique |
repositories | Array of strings or null unique |
jars | Array of strings or null unique |
archives | Array of strings or null unique |
driver_memory | string or null^(?=.*[1-9])\d+(?![\d.])(?=\D) The memory cannot be negative and decimal. |
driver_java_options | string or null non-empty |
driver_library_path | string or null non-empty |
driver_class_path | string or null non-empty |
executor_memory | string or null^(?=.*[1-9])\d+(?![\d.])(?=\D) The memory cannot be negative and decimal. |
principal | string or null non-empty |
keytab | string or null non-empty |
queue | string or null non-empty |
job_class_name | string or null non-empty |
job_command | string or null non-empty |
job_arguments | string or null non-empty |
job_rawScalaCode | string or null non-empty |
job_type | string Enum: "RAW_SCALA" "Jar" "Python3" "SQL" |
job_timeout_min | integer or null <int64> >= 1 |
driver_cores | integer or null <int32> >= 1 |
total_executor_cores | integer or null <int64> >= 1 |
executor_cores | integer or null <int32> >= 1 |
num_executors | integer or null <int32> >= 1 |
Responses
Request samples
- Payload
{- "name": "spark_examples",
- "cluster_id": "13",
- "max_concurrency": 1,
- "job_class_name": "org.apache.spark.examples.SparkPi",
- "job_command": "file:///yeedu/object-storage-manager/spark-examples_2.11-2.4.8.jar",
- "job_arguments": "1000",
- "job_rawScalaCode": null,
- "job_type": "Jar",
- "job_timeout_min": null,
- "files": [
- "file:///yeedu/object-storage-manager/privateKey"
], - "properties_file": null,
- "conf": [
- "spark.sql.files.maxRecordsPerFile=1000000",
- "spark.ui.enabled=false",
- "spark.driver.yeedu_privateKey=file:///yeedu/object-storage-manager/privateKey"
], - "packages": [
- "com.github.music-of-the-ainur:almaren-framework_2.11:0.9.3-2.4",
- "org.postgresql:postgresql:42.2.8",
- "org.apache.hadoop:hadoop-aws:2.10.1",
- "org.apache.spark:spark-hive_2.11:2.4.8"
], - "repositories": null,
- "jars": [
- "file:///yeedu/object-storage-manager/gcs-connector-hadoop2-latest.jar",
- "file:///yeedu/object-storage-manager/ojdbc6-11.2.0.4.jar"
], - "archives": null,
- "driver_memory": null,
- "driver_java_options": "-Dderby.system.home=/yeedu/spark_metastores/$(date +%s)-${RANDOM}",
- "driver_library_path": null,
- "driver_class_path": null,
- "executor_memory": null,
- "driver_cores": null,
- "total_executor_cores": null,
- "executor_cores": null,
- "num_executors": null,
- "principal": null,
- "keytab": null,
- "queue": null
}
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "job_conf_id": "1",
- "name": "spark_examples",
- "cluster_id": "1",
- "workspace_id": "1",
- "spark_job_type_lang_id": 1,
- "max_concurrency": "1",
- "job_class_name": "org.apache.spark.examples.SparkPi",
- "job_command": "file:///yeedu/object-storage-manager/spark-examples_2.11-2.4.8.jar",
- "job_rawScalaCode": null,
- "job_arguments": "500",
- "files": [
- "file:///yeedu/object-storage-manager/privateKey"
], - "properties_file": null,
- "conf": [
- "spark.sql.files.maxRecordsPerFile=1000000",
- "spark.ui.enabled=false",
- "spark.driver.yeedu_privateKey=file:///yeedu/object-storage-manager/privateKey"
], - "packages": [
- "com.github.music-of-the-ainur:almaren-framework_2.11:0.9.3-2.4",
- "org.postgresql:postgresql:42.2.8",
- "org.apache.hadoop:hadoop-aws:2.10.1",
- "org.apache.spark:spark-hive_2.11:2.4.8"
], - "repositories": null,
- "jars": [
- "file:///yeedu/object-storage-manager/gcs-connector-hadoop2-latest.jar",
- "file:///yeedu/object-storage-manager/ojdbc6-11.2.0.4.jar"
], - "archives": null,
- "driver_memory": null,
- "driver_java_options": "-Dderby.system.home=/yeedu/spark_metastores/1666766426-8439",
- "driver_library_path": null,
- "driver_class_path": null,
- "executor_memory": null,
- "driver_cores": null,
- "total_executor_cores": null,
- "executor_cores": null,
- "num_executors": null,
- "principal": null,
- "keytab": null,
- "queue": null,
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T08:01:54.932Z",
- "from_date": "2024-06-20T17:24:19.782Z",
- "to_date": null
}
Enable a specific Spark job configuration.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
job_conf_id | integer <int64> Specifies the ID of the Spark job configuration to enable. |
job_conf_name | string Specifies the name of the Spark job configuration to enable. |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "job_conf_id": "1",
- "name": "spark_examples",
- "cluster_id": "1",
- "workspace_id": "1",
- "spark_job_type_lang_id": 1,
- "max_concurrency": "1",
- "job_class_name": "org.apache.spark.examples.SparkPi",
- "job_command": "file:///yeedu/object-storage-manager/spark-examples_2.11-2.4.8.jar",
- "job_rawScalaCode": null,
- "job_arguments": "500",
- "files": [
- "file:///yeedu/object-storage-manager/privateKey"
], - "properties_file": null,
- "conf": [
- "spark.sql.files.maxRecordsPerFile=1000000",
- "spark.ui.enabled=false",
- "spark.driver.yeedu_privateKey=file:///yeedu/object-storage-manager/privateKey"
], - "packages": [
- "com.github.music-of-the-ainur:almaren-framework_2.11:0.9.3-2.4",
- "org.postgresql:postgresql:42.2.8",
- "org.apache.hadoop:hadoop-aws:2.10.1",
- "org.apache.spark:spark-hive_2.11:2.4.8"
], - "repositories": null,
- "jars": [
- "file:///yeedu/object-storage-manager/gcs-connector-hadoop2-latest.jar",
- "file:///yeedu/object-storage-manager/ojdbc6-11.2.0.4.jar"
], - "archives": null,
- "driver_memory": null,
- "driver_java_options": "-Dderby.system.home=/yeedu/spark_metastores/1666766426-8439",
- "driver_library_path": null,
- "driver_class_path": null,
- "executor_memory": null,
- "driver_cores": null,
- "total_executor_cores": null,
- "executor_cores": null,
- "num_executors": null,
- "principal": null,
- "keytab": null,
- "queue": null,
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T08:01:54.932Z",
- "from_date": "2024-06-20T17:24:19.782Z",
- "to_date": null
}
Disable a specific Spark job configuration.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
job_conf_id | integer <int64> Specifies the ID of the Spark job configuration to disable. |
job_conf_name | string Specifies the name of the Spark job configuration to disable. |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "job_conf_id": "1",
- "name": "spark_examples",
- "cluster_id": "1",
- "workspace_id": "1",
- "spark_job_type_lang_id": 1,
- "max_concurrency": "1",
- "job_class_name": "org.apache.spark.examples.SparkPi",
- "job_command": "file:///yeedu/object-storage-manager/spark-examples_2.11-2.4.8.jar",
- "job_rawScalaCode": null,
- "job_arguments": "500",
- "files": [
- "file:///yeedu/object-storage-manager/privateKey"
], - "properties_file": null,
- "conf": [
- "spark.sql.files.maxRecordsPerFile=1000000",
- "spark.ui.enabled=false",
- "spark.driver.yeedu_privateKey=file:///yeedu/object-storage-manager/privateKey"
], - "packages": [
- "com.github.music-of-the-ainur:almaren-framework_2.11:0.9.3-2.4",
- "org.postgresql:postgresql:42.2.8",
- "org.apache.hadoop:hadoop-aws:2.10.1",
- "org.apache.spark:spark-hive_2.11:2.4.8"
], - "repositories": null,
- "jars": [
- "file:///yeedu/object-storage-manager/gcs-connector-hadoop2-latest.jar",
- "file:///yeedu/object-storage-manager/ojdbc6-11.2.0.4.jar"
], - "archives": null,
- "driver_memory": null,
- "driver_java_options": "-Dderby.system.home=/yeedu/spark_metastores/1666766426-8439",
- "driver_library_path": null,
- "driver_class_path": null,
- "executor_memory": null,
- "driver_cores": null,
- "total_executor_cores": null,
- "executor_cores": null,
- "num_executors": null,
- "principal": null,
- "keytab": null,
- "queue": null,
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T08:04:09.298Z",
- "from_date": "2024-06-20T17:24:19.782Z",
- "to_date": "2024-06-21T08:04:09.298Z"
}
Get all Spark job instances.
Retrieves a list of Spark job instances.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
cluster_id | integer <int64> Cluster instance ID used for filtering. |
job_conf_id | integer <int64> Specifies the ID of the Spark job configuration for filtering. |
job_conf_name | string Specifies the name of the Spark job configuration for filtering. |
job_status | string Enum: "SUBMITTED" "RUNNING" "DONE" "ERROR" "TERMINATED" "STOPPING" "STOPPED" Specifies the status of the Spark job instance for filtering. |
job_type | string Enum: "SPARK_JOB" "SPARK_SQL" "NOTEBOOK" Specifies the job type of the Spark job instance for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "job_id": 298,
- "job_application_id": "local-1718959721329",
- "job_status": "DONE",
- "total_job_time_sec": 8.105467,
- "job_execution_time_sec": 6.300996,
- "job_conf": {
- "job_conf_id": 23,
- "name": "spark_example",
- "spark_job_type": {
- "job_type": "SPARK_JOB",
- "language": "Jar"
}, - "cluster_info": {
- "cluster_id": 13,
- "name": "gcp_test",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "cloud_env": {
- "cloud_env_id": 11,
- "name": "test",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP"
}
}, - "cluster_conf": {
- "cluster_conf_id": 10,
- "cluster_conf_name": "n1-standard-4",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 10,
- "name": "n1-standard-4",
- "vCPUs": 4,
- "memory": "15 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Scalable (Skylake) 1st Generation",
- "Intel Xeon E5 v4 (Broadwell E5)",
- "Intel Xeon E5 v3 (Haswell)",
- "Intel Xeon E5 v2 (Ivy Bridge)",
- "Intel Xeon E5 (Sandy Bridge)"
], - "cpu_min_frequency_GHz": [
- "2.0",
- "2.2",
- "2.3",
- "2.5",
- "2.6"
], - "cpu_max_frequency_GHz": [
- "3.5",
- "3.7",
- "3.8",
- "3.5",
- "3.6"
], - "has_local_disk": false,
- "local_disk_size_GB": null,
- "local_num_of_disks": null,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.5
}, - "machine_volume_conf": {
- "volume_conf_id": 2,
- "name": "volume_gcp_2",
- "size": 375,
- "machine_volume_num": 2,
- "machine_volume_strip_num": 2
}
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}
}
}, - "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "created_by": {
- "user_id": 3,
- "username": "rp0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 3,
- "username": "rp0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-21T08:48:37.459181+00:00",
- "from_date": "2024-06-21T08:48:37.459181+00:00",
- "to_date": "2024-06-21T08:48:45.564648+00:00"
}
]
}
Search Spark job instances by job configuration name.
Retrieves a list of Spark job instances based on a search by job configuration name.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
cluster_id | integer <int64> Cluster instance ID used for filtering. |
job_conf_name required | string Specifies the name of the Spark job configuration to search for. |
job_type | string Enum: "SPARK_JOB" "SPARK_SQL" "NOTEBOOK" Specifies the job type of the Spark job instance for filtering. |
job_status | string Enum: "SUBMITTED" "RUNNING" "DONE" "ERROR" "TERMINATED" "STOPPING" "STOPPED" Specifies the status of the Spark job instance for filtering. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "job_id": 298,
- "job_application_id": "local-1718959721329",
- "job_status": "DONE",
- "total_job_time_sec": 8.105467,
- "job_execution_time_sec": 6.300996,
- "job_conf": {
- "job_conf_id": 23,
- "name": "spark_example",
- "spark_job_type": {
- "job_type": "SPARK_JOB",
- "language": "Jar"
}, - "cluster_info": {
- "cluster_id": 13,
- "name": "gcp_test",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "cloud_env": {
- "cloud_env_id": 11,
- "name": "test",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP"
}
}, - "cluster_conf": {
- "cluster_conf_id": 10,
- "cluster_conf_name": "n1-standard-4",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 10,
- "name": "n1-standard-4",
- "vCPUs": 4,
- "memory": "15 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Scalable (Skylake) 1st Generation",
- "Intel Xeon E5 v4 (Broadwell E5)",
- "Intel Xeon E5 v3 (Haswell)",
- "Intel Xeon E5 v2 (Ivy Bridge)",
- "Intel Xeon E5 (Sandy Bridge)"
], - "cpu_min_frequency_GHz": [
- "2.0",
- "2.2",
- "2.3",
- "2.5",
- "2.6"
], - "cpu_max_frequency_GHz": [
- "3.5",
- "3.7",
- "3.8",
- "3.5",
- "3.6"
], - "has_local_disk": false,
- "local_disk_size_GB": null,
- "local_num_of_disks": null,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.5
}, - "machine_volume_conf": {
- "volume_conf_id": 2,
- "name": "volume_gcp_2",
- "size": 375,
- "machine_volume_num": 2,
- "machine_volume_strip_num": 2
}
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}
}
}, - "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "created_by": {
- "user_id": 3,
- "username": "rp0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 3,
- "username": "rp0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-21T08:48:37.459181+00:00",
- "from_date": "2024-06-21T08:48:37.459181+00:00",
- "to_date": "2024-06-21T08:48:45.564648+00:00"
}
]
}
Create a new Spark job instance.
A Spark job instance for a specific configuration can only be created if the attached cluster instance is not in ERROR, DESTROYING, or DESTROYED states.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
Request Body schema: application/jsonrequired
The Spark job configuration to be used.
job_conf_id | integer <int64> |
job_conf_name | string non-empty |
Responses
Request samples
- Payload
{- "job_conf_id": 1
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "job_id": "297",
- "job_conf_id": "23",
- "cluster_id": "13",
- "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "created_by_user_id": "3",
- "modified_by_user_id": "3",
- "last_update_date": "2024-06-21T08:47:55.301Z",
- "from_date": "2024-06-21T08:47:55.301Z",
- "to_date": null
}
Get details of a specific Spark job instance.
Retrieve Spark job instance configuration details by ID.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
job_id required | integer <int64> Specifies the ID of the Spark job instance for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "job_id": 298,
- "job_application_id": "local-1718959721329",
- "job_status": "DONE",
- "job_execution_time_sec": 6.300996,
- "total_job_time_sec": 8.105467,
- "job_conf": {
- "job_conf_id": 23,
- "name": "spark_example",
- "spark_job_type": {
- "job_type": "SPARK_JOB",
- "language": "Jar"
}, - "cluster_info": {
- "cluster_id": 13,
- "name": "gcp_test",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "cloud_env": {
- "cloud_env_id": 11,
- "name": "test",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP"
}
}, - "cluster_conf": {
- "cluster_conf_id": 10,
- "cluster_conf_name": "n1-standard-4",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 10,
- "name": "n1-standard-4",
- "vCPUs": 4,
- "memory": "15 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Scalable (Skylake) 1st Generation",
- "Intel Xeon E5 v4 (Broadwell E5)",
- "Intel Xeon E5 v3 (Haswell)",
- "Intel Xeon E5 v2 (Ivy Bridge)",
- "Intel Xeon E5 (Sandy Bridge)"
], - "cpu_min_frequency_GHz": [
- "2.0",
- "2.2",
- "2.3",
- "2.5",
- "2.6"
], - "cpu_max_frequency_GHz": [
- "3.5",
- "3.7",
- "3.8",
- "3.5",
- "3.6"
], - "has_local_disk": false,
- "local_disk_size_GB": null,
- "local_num_of_disks": null,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.5
}, - "machine_volume_conf": {
- "volume_conf_id": 2,
- "name": "volume_gcp_2",
- "size": 375,
- "machine_volume_num": 2,
- "machine_volume_strip_num": 2
}
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}
}
}, - "workflow_job_instance_details": {
- "workflow_job_instance_status": {
- "workflow_job_instance_id": 354,
- "workflow_job_id": 354,
- "status": "DONE",
- "from_date": "2024-06-21T08:48:37.459181+00:00",
- "to_date": "2024-06-21T08:48:45.564648+00:00"
}, - "workflow_execution_process": {
- "machine_pid_number": "1580",
- "machine_hostname": "yeedu13-c9b7944b-b5c1-33ad-6055-78cc47b1769a",
- "machine_id": "c9b7944b-b5c1-33ad-6055-78cc47b1769a",
- "machine_pid_user": "root",
- "machine_node_number": "0"
}
}, - "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "created_by": {
- "user_id": 3,
- "username": "rp0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 3,
- "username": "rp0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-21T08:48:37.459181+00:00",
- "from_date": "2024-06-21T08:48:37.459181+00:00",
- "to_date": "2024-06-21T08:48:45.564648+00:00"
}
Get Spark job instance status details.
Retrieve Spark job instance run details in the sequential order of state transitions during execution.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
job_id required | integer <int64> Specifies the ID of the Spark job instance for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "job_status": "SUBMITTED",
- "created_by": "rp0000-yeedu@yeedu.io",
- "start_time": "2024-06-21T08:48:37.459181+00:00",
- "end_time": "2024-06-21T08:48:38.003953+00:00"
}, - {
- "job_status": "RUNNING",
- "created_by": "rp0000-yeedu@yeedu.io",
- "start_time": "2024-06-21T08:48:38.003953+00:00",
- "end_time": "2024-06-21T08:48:44.304949+00:00"
}, - {
- "job_status": "STOPPING",
- "created_by": "rp0000-yeedu@yeedu.io",
- "start_time": "2024-06-21T08:48:44.304949+00:00",
- "end_time": "2024-06-21T08:48:45.564648+00:00"
}, - {
- "job_status": "STOPPED",
- "created_by": "rp0000-yeedu@yeedu.io",
- "start_time": "2024-06-21T08:48:45.564648+00:00",
- "end_time": "infinity"
}
]
Stop a Spark job instance.
A Spark job instance can only be stopped if its status is SUBMITTED or RUNNING.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
job_id required | integer <int64> Specifies the ID of the Spark job instance to stop. |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "SparkKill": {
- "workflow_job_id": 354,
- "workflow_job_instance_id": 354,
- "spark_job_instance_id": 298,
- "spark_job_id": 23,
- "compute_engine_id": 13
}
}
Get workflow job execution details of a Spark job instance.
Retrieve workflow job execution details for a specific Spark job application ID.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
job_application_id required | string Specifies the application ID of the Spark job instance for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "job_id": 298,
- "job_application_id": "local-1718959721329",
- "job_status": "DONE",
- "compute_engine": 13,
- "cluster_id": "13",
- "workflow_job_instance_details": {
- "workflow_job_instance_status": {
- "workflow_job_instance_id": 354,
- "workflow_job_id": 354,
- "status": "DONE",
- "previous_status": [
- "NONE",
- "INIT",
- "SENT",
- "RECEIVED",
- "EXECUTING"
], - "from_date": "2024-06-21T08:48:45.564648+00:00",
- "to_date": "infinity"
}, - "workflow_execution_process": {
- "machine_pid_number": "1580",
- "machine_hostname": "yeedu13-c9b7944b-b5c1-33ad-6055-78cc47b1769a",
- "machine_id": "c9b7944b-b5c1-33ad-6055-78cc47b1769a",
- "machine_pid_user": "root",
- "machine_node_number": "0"
}
}, - "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "created_by": {
- "user_id": 3,
- "username": "rp0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 3,
- "username": "rp0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-21T08:48:37.459181+00:00",
- "from_date": "2024-06-21T08:48:37.459181+00:00",
- "to_date": "2024-06-21T08:48:45.564648+00:00"
}
Download Spark job instance logs.
Retrieve stdout or stderr log files of a Spark job instance.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
job_id required | integer <int64> Specifies the ID of the Spark job instance for filtering. |
log_type required | string Enum: "stdout" "stderr" The type of log file to filter. |
Responses
Response samples
- 400
- 401
- 404
- 500
{- "error_code": "string",
- "error_message": "string"
}
Get workflow errors of a Spark job instance.
Retrieve workflow errors for a specific Spark job instance.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
job_id required | integer <int64> Specifies the ID of the Spark job instance for filtering. |
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "error": "OnError(Process finish with exit code 137,None,None,None,Some(akka.stream.alpakka.amqp.impl.AmqpSourceStage$$anon$1$$anon$2$$anon$3@47b8c55f))"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 10
}
}
Get all history engine cluster instances.
Retrieves a list of engine cluster instances used by Spark job instances within a workspace.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "cluster_id": 1,
- "cluster_name": "yeedu_cluster"
}
]
Get all notebook configurations.
Retrieves a list of notebook configurations.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
enable | boolean Enum: true false Specifies which notebook configurations to list.
Note: If unspecified, all notebook configurations (both active and disabled) will be listed. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "notebook_conf_id": 27,
- "notebook_name": "test_notebook",
- "spark_job_type": {
- "job_type": "NOTEBOOK",
- "language": "Python3"
}, - "cluster_info": {
- "cluster_id": 13,
- "name": "gcp_test",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "cloud_env": {
- "cloud_env_id": 11,
- "name": "test",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP"
}
}, - "cluster_conf": {
- "cluster_conf_id": 10,
- "cluster_conf_name": "n1-standard-4",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 10,
- "name": "n1-standard-4",
- "vCPUs": 4,
- "memory": "15 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Scalable (Skylake) 1st Generation",
- "Intel Xeon E5 v4 (Broadwell E5)",
- "Intel Xeon E5 v3 (Haswell)",
- "Intel Xeon E5 v2 (Ivy Bridge)",
- "Intel Xeon E5 (Sandy Bridge)"
], - "cpu_min_frequency_GHz": [
- "2.0",
- "2.2",
- "2.3",
- "2.5",
- "2.6"
], - "cpu_max_frequency_GHz": [
- "3.5",
- "3.7",
- "3.8",
- "3.5",
- "3.6"
], - "has_local_disk": false,
- "local_disk_size_GB": null,
- "local_num_of_disks": null,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.5
}, - "machine_volume_conf": {
- "volume_conf_id": 2,
- "name": "volume_gcp_2",
- "size": 375,
- "machine_volume_num": 2,
- "machine_volume_strip_num": 2
}
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}
}, - "last_notebook_run": {
- "notebook_id": 299,
- "notebook_status": "RUNNING"
}, - "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-21T09:14:40.88+00:00",
- "from_date": "2024-06-21T09:09:30.277914+00:00",
- "to_date": "infinity"
}
]
}
Search notebook configurations by configuration name.
Retrieves a list of notebook configurations based on a search by configuration name.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
notebook_name required | string Specifies the name of the notebook configuration to search for. |
enable | boolean Enum: true false Specifies which notebook configurations to search.
Note: If unspecified, all notebook configurations (both active and disabled) will be searched. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "notebook_conf_id": 27,
- "notebook_name": "test_notebook",
- "spark_job_type": {
- "job_type": "NOTEBOOK",
- "language": "Python3"
}, - "cluster_info": {
- "cluster_id": 13,
- "name": "gcp_test",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "cloud_env": {
- "cloud_env_id": 11,
- "name": "test",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP"
}
}, - "cluster_conf": {
- "cluster_conf_id": 10,
- "cluster_conf_name": "n1-standard-4",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 10,
- "name": "n1-standard-4",
- "vCPUs": 4,
- "memory": "15 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Scalable (Skylake) 1st Generation",
- "Intel Xeon E5 v4 (Broadwell E5)",
- "Intel Xeon E5 v3 (Haswell)",
- "Intel Xeon E5 v2 (Ivy Bridge)",
- "Intel Xeon E5 (Sandy Bridge)"
], - "cpu_min_frequency_GHz": [
- "2.0",
- "2.2",
- "2.3",
- "2.5",
- "2.6"
], - "cpu_max_frequency_GHz": [
- "3.5",
- "3.7",
- "3.8",
- "3.5",
- "3.6"
], - "has_local_disk": false,
- "local_disk_size_GB": null,
- "local_num_of_disks": null,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.5
}, - "machine_volume_conf": {
- "volume_conf_id": 2,
- "name": "volume_gcp_2",
- "size": 375,
- "machine_volume_num": 2,
- "machine_volume_strip_num": 2
}
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}
}, - "last_notebook_run": {
- "notebook_id": 299,
- "notebook_status": "RUNNING"
}, - "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-21T09:14:40.88+00:00",
- "from_date": "2024-06-21T09:09:30.277914+00:00",
- "to_date": "infinity"
}
]
}
Create a new notebook configuration.
Creates a notebook configuration with the provided configurations.
max_concurrency: Specifies the maximum number of concurrent notebook instances allowed for the configuration.
- By default,
max_concurrency
is set to 1 and is non-editable for a notebook configuration.
- By default,
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
Request Body schema: application/jsonrequired
The notebook configuration to be added.
cluster_id | integer <int64> |
cluster_name | string non-empty |
notebook_name required | string non-empty |
notebook_type required | string Enum: "python3" "scala" |
conf | Array of strings unique [ items non-empty ] |
packages | Array of strings unique [ items non-empty ] |
jars | Array of strings unique [ items non-empty ] |
files | Array of strings unique [ items non-empty ] |
driver_memory | string or null^(?=.*[1-9])\d+(?![\d.])(?=\D) The memory cannot be negative and decimal. |
executor_memory | string or null^(?=.*[1-9])\d+(?![\d.])(?=\D) The memory cannot be negative and decimal. |
driver_cores | integer or null <int32> >= 1 |
total_executor_cores | integer or null <int64> >= 1 |
executor_cores | integer or null <int32> >= 1 |
num_executors | integer or null <int32> >= 1 |
Responses
Request samples
- Payload
{- "notebook_name": "test_notebook",
- "cluster_name": "yeedu_instance",
- "notebook_type": "python3",
- "conf": [
- "spark.sql.files.maxRecordsPerFile=1000000",
- "spark.ui.enabled=false",
- "spark.driver.yeedu_privateKey=file:///yeedu/object-storage-manager/privateKey"
], - "packages": [
- "com.github.music-of-the-ainur:almaren-framework_2.11:0.9.3-2.4",
- "org.postgresql:postgresql:42.2.8",
- "org.apache.hadoop:hadoop-aws:2.10.1",
- "org.apache.spark:spark-hive_2.11:2.4.8"
], - "jars": [
- "file:///yeedu/object-storage-manager/gcs-connector-hadoop2-latest.jar",
- "file:///yeedu/object-storage-manager/ojdbc6-11.2.0.4.jar"
]
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "notebook_conf_id": "27",
- "notebook_name": "test_notebook",
- "cluster_id": "13",
- "workspace_id": "5",
- "spark_job_type_lang_id": 3,
- "max_concurrency": "1",
- "notebook_cells": {
- "cells": [
- {
- "cell_uuid": "9db6dc90-a190-4bbf-af0e-7b615776ca57",
- "order": 0,
- "code": "",
- "output": [ ],
- "runStatus": false,
- "executionCount": 0,
- "isOutputError": false
}
]
}, - "notebook_cells_auto_save": null,
- "conf": null,
- "packages": null,
- "jars": null,
- "files": null,
- "driver_memory": null,
- "executor_memory": null,
- "driver_cores": null,
- "total_executor_cores": null,
- "executor_cores": null,
- "num_executors": null,
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T09:09:30.277Z",
- "from_date": "2024-06-21T09:09:30.277Z",
- "to_date": null
}
Get details of a specific notebook configuration.
Retrieve notebook configuration details filtered by ID or name.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
notebook_conf_id | integer <int64> Specifies the ID of the notebook configuration for filtering. |
notebook_name | string Specifies the name of the notebook configuration for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "notebook_conf_id": 27,
- "notebook_name": "test_notebook",
- "cluster_info": {
- "cluster_id": 13,
- "name": "gcp_test",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "cluster_conf": {
- "cluster_conf_id": 10,
- "cluster_conf_name": "n1-standard-4",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 10,
- "name": "n1-standard-4",
- "vCPUs": 4,
- "memory": "15 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Scalable (Skylake) 1st Generation",
- "Intel Xeon E5 v4 (Broadwell E5)",
- "Intel Xeon E5 v3 (Haswell)",
- "Intel Xeon E5 v2 (Ivy Bridge)",
- "Intel Xeon E5 (Sandy Bridge)"
], - "cpu_min_frequency_GHz": [
- "2.0",
- "2.2",
- "2.3",
- "2.5",
- "2.6"
], - "cpu_max_frequency_GHz": [
- "3.5",
- "3.7",
- "3.8",
- "3.5",
- "3.6"
], - "has_local_disk": false,
- "local_disk_size_GB": null,
- "local_num_of_disks": null,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.5
}, - "machine_volume_conf": {
- "volume_conf_id": 2,
- "name": "volume_gcp_2",
- "size": 375,
- "machine_volume_num": 2,
- "machine_volume_strip_num": 2
}
}, - "cloud_env": {
- "cloud_env_id": 11,
- "name": "test",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP"
}
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}
}, - "spark_job_type": {
- "job_type": "NOTEBOOK",
- "language": "Python3"
}, - "max_concurrency": 1,
- "notebook_cells": {
- "cells": [
- {
- "cell_uuid": "9db6dc90-a190-4bbf-af0e-7b615776ca57",
- "order": 0,
- "code": "",
- "output": [ ],
- "runStatus": false,
- "executionCount": 0,
- "isOutputError": false
}
]
}, - "files": null,
- "conf": null,
- "packages": null,
- "jars": null,
- "driver_memory": null,
- "driver_java_options": null,
- "driver_library_path": null,
- "driver_class_path": null,
- "executor_memory": null,
- "driver_cores": null,
- "total_executor_cores": null,
- "executor_cores": null,
- "num_executors": null,
- "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-21T09:09:30.277914+00:00",
- "from_date": "2024-06-21T09:09:30.277914+00:00",
- "to_date": "infinity"
}
Update details of a specific notebook configuration.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
notebook_conf_id | integer <int64> Specifies the ID of the notebook configuration for modification. |
notebook_name | string Specifies the name of the notebook configuration for modification. |
Request Body schema: application/jsonrequired
Notebook configuration details to be modified.
notebook_name | string non-empty |
cluster_name | string non-empty |
cluster_id | integer <int64> |
conf | Array of strings or null unique |
packages | Array of strings or null unique |
jars | Array of strings or null unique |
files | Array of strings or null unique |
driver_memory | string or null^(?=.*[1-9])\d+(?![\d.])(?=\D) The memory cannot be negative and decimal. |
executor_memory | string or null^(?=.*[1-9])\d+(?![\d.])(?=\D) The memory cannot be negative and decimal. |
driver_cores | integer or null <int32> >= 1 |
total_executor_cores | integer or null <int64> >= 1 |
executor_cores | integer or null <int32> >= 1 |
num_executors | integer or null <int32> >= 1 |
Responses
Request samples
- Payload
{- "notebook_name": "test_notebook",
- "cluster_id": "13",
- "notebook_cells": {
- "cells": [
- {
- "cell_uuid": "f0db0dbe-aa2e-4fb6-bdff-7aa85f36c3ae",
- "order": 0,
- "code": "",
- "output": [ ],
- "runStatus": false,
- "executionCount": 0,
- "isOutputError": false
}
]
}, - "notebook_cells_auto_save": null,
- "conf": null,
- "packages": null,
- "jars": null,
- "files": null,
- "driver_memory": null,
- "executor_memory": null,
- "driver_cores": null,
- "total_executor_cores": null,
- "executor_cores": null,
- "num_executors": null
}
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "notebook_conf_id": "27",
- "notebook_name": "test_notebook",
- "cluster_id": "13",
- "workspace_id": "5",
- "spark_job_type_lang_id": 3,
- "max_concurrency": "1",
- "notebook_cells": {
- "cells": [
- {
- "cell_uuid": "9db6dc90-a190-4bbf-af0e-7b615776ca57",
- "order": 0,
- "code": "",
- "output": [ ],
- "runStatus": false,
- "executionCount": 0,
- "isOutputError": false
}
]
}, - "notebook_cells_auto_save": null,
- "conf": null,
- "packages": null,
- "jars": null,
- "files": null,
- "driver_memory": null,
- "executor_memory": null,
- "driver_cores": null,
- "total_executor_cores": null,
- "executor_cores": null,
- "num_executors": null,
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T09:09:30.277Z",
- "from_date": "2024-06-21T09:09:30.277Z",
- "to_date": null
}
Enable a specific notebook configuration.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
notebook_conf_id | integer <int64> Specifies the ID of the notebook configuration to enable. |
notebook_name | string Specifies the name of the notebook configuration to enable. |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "notebook_conf_id": "27",
- "notebook_name": "test_notebook",
- "cluster_id": "13",
- "workspace_id": "5",
- "spark_job_type_lang_id": 3,
- "max_concurrency": "1",
- "notebook_cells": {
- "cells": [
- {
- "cell_uuid": "9db6dc90-a190-4bbf-af0e-7b615776ca57",
- "order": 0,
- "code": "",
- "output": [ ],
- "runStatus": false,
- "executionCount": 0,
- "isOutputError": false
}
]
}, - "notebook_cells_auto_save": null,
- "conf": null,
- "packages": null,
- "jars": null,
- "files": null,
- "driver_memory": null,
- "executor_memory": null,
- "driver_cores": null,
- "total_executor_cores": null,
- "executor_cores": null,
- "num_executors": null,
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T09:09:30.277Z",
- "from_date": "2024-06-21T09:09:30.277Z",
- "to_date": null
}
Disable a specific notebook configuration.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
notebook_conf_id | integer <int64> Specifies the ID of the notebook configuration to disable. |
notebook_name | string Specifies the name of the notebook configuration to disable. |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "notebook_conf_id": "26",
- "notebook_name": "test_notebook",
- "cluster_id": "13",
- "workspace_id": "5",
- "spark_job_type_lang_id": 3,
- "max_concurrency": "1",
- "notebook_cells": {
- "cells": [
- {
- "cell_uuid": "f0db0dbe-aa2e-4fb6-bdff-7aa85f36c3ae",
- "order": 0,
- "code": "",
- "output": [ ],
- "runStatus": false,
- "executionCount": 0,
- "isOutputError": false
}
]
}, - "notebook_cells_auto_save": null,
- "conf": null,
- "packages": null,
- "jars": null,
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T09:25:58.823Z",
- "from_date": "2024-06-21T09:09:11.436Z",
- "to_date": "2024-06-21T09:25:58.823Z"
}
Update notebook cell data for a specific notebook configuration.
Updates the cell data within a notebook configuration.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
notebook_conf_id required | integer <int64> Specifies the ID of the notebook configuration for modification. |
Request Body schema: application/jsonrequired
Notebook configuration cell data to be updated.
required | Array of objects non-empty | ||||||||
Array (non-empty)
|
Responses
Request samples
- Payload
{- "cells": [
- {
- "cell_uuid": "4a5fa4e4-5e34-4a2d-859e-0a520b8f25ac",
- "code": "print('Hello Yeedu')"
}, - {
- "cell_uuid": "bad4646d-6b6e-4a39-a146-ee90db85e26c",
- "code": "print('Hello World')"
}
]
}
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "notebook_conf_id": "6",
- "notebook_name": "Notebook_01",
- "cluster_id": "1",
- "workspace_id": "2",
- "spark_job_type_lang_id": 3,
- "max_concurrency": "1",
- "notebook_cells": {
- "cells": [
- {
- "cell_uuid": "4a5fa4e4-5e34-4a2d-859e-0a520b8f25ac",
- "code": "print('Hello Yeedu')"
}, - {
- "cell_uuid": "bad4646d-6b6e-4a39-a146-ee90db85e26c",
- "code": "print('Hello World')"
}
]
}, - "notebook_cells_auto_save": null,
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2023-08-08T13:10:10.717Z",
- "from_date": "2023-08-07T11:53:48.326Z",
- "to_date": null
}
Get all notebook instances.
Retrieves a list of notebook instances.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
cluster_id | integer <int64> Cluster instance ID used for filtering. |
notebook_conf_id | integer <int64> Specifies the ID of the notebook configuration for filtering. |
notebook_name | string Specifies the name of the notebook configuration for filtering. |
notebook_status | string Enum: "SUBMITTED" "RUNNING" "DONE" "ERROR" "TERMINATED" "STOPPING" "STOPPED" Specifies the status of the notebook instance for filtering. |
isActive | boolean Enum: true false Specifies whether to list only active notebook instances that are in the RUNNING or SUBMITTED state. |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "notebook_id": 299,
- "notebook_status": "STOPPED",
- "notebook_conf": {
- "notebook_conf_id": 27,
- "notebook_name": "Notebook_01",
- "notebook_job_type": {
- "job_type": "NOTEBOOK",
- "language": "Python3"
}, - "cluster_info": {
- "cluster_id": 13,
- "name": "gcp_test",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "cloud_env": {
- "cloud_env_id": 11,
- "name": "test",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP"
}
}, - "cluster_conf": {
- "cluster_conf_id": 10,
- "cluster_conf_name": "n1-standard-4",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 10,
- "name": "n1-standard-4",
- "vCPUs": 4,
- "memory": "15 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Scalable (Skylake) 1st Generation",
- "Intel Xeon E5 v4 (Broadwell E5)",
- "Intel Xeon E5 v3 (Haswell)",
- "Intel Xeon E5 v2 (Ivy Bridge)",
- "Intel Xeon E5 (Sandy Bridge)"
], - "cpu_min_frequency_GHz": [
- "2.0",
- "2.2",
- "2.3",
- "2.5",
- "2.6"
], - "cpu_max_frequency_GHz": [
- "3.5",
- "3.7",
- "3.8",
- "3.5",
- "3.6"
], - "has_local_disk": false,
- "local_disk_size_GB": null,
- "local_num_of_disks": null,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.5
}, - "machine_volume_conf": {
- "volume_conf_id": 2,
- "name": "volume_gcp_2",
- "size": 375,
- "machine_volume_num": 2,
- "machine_volume_strip_num": 2
}
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}
}
}, - "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-21T09:13:47.789222+00:00",
- "from_date": "2024-06-21T09:13:47.789222+00:00",
- "to_date": "2024-06-21T09:20:26.56676+00:00"
}
]
}
Search notebook instances by notebook configuration name.
Retrieves a list of notebook instances based on a search by notebook configuration name.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
query Parameters
notebook_name required | string Notebook Name that will be used for filter |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "notebook_id": 299,
- "notebook_status": "STOPPED",
- "notebook_conf": {
- "notebook_conf_id": 27,
- "notebook_name": "Notebook_01",
- "notebook_job_type": {
- "job_type": "NOTEBOOK",
- "language": "Python3"
}, - "cluster_info": {
- "cluster_id": 13,
- "name": "gcp_test",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "cloud_env": {
- "cloud_env_id": 11,
- "name": "test",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP"
}
}, - "cluster_conf": {
- "cluster_conf_id": 10,
- "cluster_conf_name": "n1-standard-4",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 10,
- "name": "n1-standard-4",
- "vCPUs": 4,
- "memory": "15 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Scalable (Skylake) 1st Generation",
- "Intel Xeon E5 v4 (Broadwell E5)",
- "Intel Xeon E5 v3 (Haswell)",
- "Intel Xeon E5 v2 (Ivy Bridge)",
- "Intel Xeon E5 (Sandy Bridge)"
], - "cpu_min_frequency_GHz": [
- "2.0",
- "2.2",
- "2.3",
- "2.5",
- "2.6"
], - "cpu_max_frequency_GHz": [
- "3.5",
- "3.7",
- "3.8",
- "3.5",
- "3.6"
], - "has_local_disk": false,
- "local_disk_size_GB": null,
- "local_num_of_disks": null,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.5
}, - "machine_volume_conf": {
- "volume_conf_id": 2,
- "name": "volume_gcp_2",
- "size": 375,
- "machine_volume_num": 2,
- "machine_volume_strip_num": 2
}
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}
}
}, - "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-21T09:13:47.789222+00:00",
- "from_date": "2024-06-21T09:13:47.789222+00:00",
- "to_date": "2024-06-21T09:20:26.56676+00:00"
}
]
}
Create a new notebook instance.
A notebook instance for a specific configuration can only be created if the attached cluster instance is not in ERROR, DESTROYING, or DESTROYED states.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
Request Body schema: application/jsonrequired
The notebook configuration to be used.
notebook_conf_id | integer <int64> |
notebook_name | string non-empty |
Responses
Request samples
- Payload
{- "notebook_conf_id": 1
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "notebook_id": "301",
- "notebook_conf_id": "27",
- "cluster_id": "13",
- "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T10:27:43.768Z",
- "from_date": "2024-06-21T10:27:43.768Z",
- "to_date": null
}
Get details of a specific notebook instance.
Retrieve notebook instance configuration details by ID.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
notebook_id required | integer <int64> Specifies the ID of the notebook instance for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "notebook_id": 299,
- "notebook_status": "STOPPED",
- "job_execution_time_sec": 397.906651,
- "total_job_time_sec": 398.777538,
- "notebook_conf": {
- "notebook_conf_id": 27,
- "notebook_name": "Notebook_01",
- "notebook_job_type": {
- "job_type": "NOTEBOOK",
- "language": "Python3"
}, - "cluster_info": {
- "cluster_id": 13,
- "name": "gcp_test",
- "cluster_status": "RUNNING",
- "cluster_type": "YEEDU",
- "instance_size": 1,
- "min_instances": 1,
- "max_instances": 1,
- "cloud_env": {
- "cloud_env_id": 11,
- "name": "test",
- "cloud_provider": {
- "cloud_provider_id": 0,
- "name": "GCP"
}
}, - "cluster_conf": {
- "cluster_conf_id": 10,
- "cluster_conf_name": "n1-standard-4",
- "machine_type_category": "general_purpose",
- "machine_type": {
- "machine_type_id": 10,
- "name": "n1-standard-4",
- "vCPUs": 4,
- "memory": "15 GiB",
- "has_cuda": false,
- "gpu_model": null,
- "gpus": 0,
- "gpu_memory": null,
- "cpu_model": [
- "Intel Xeon Scalable (Skylake) 1st Generation",
- "Intel Xeon E5 v4 (Broadwell E5)",
- "Intel Xeon E5 v3 (Haswell)",
- "Intel Xeon E5 v2 (Ivy Bridge)",
- "Intel Xeon E5 (Sandy Bridge)"
], - "cpu_min_frequency_GHz": [
- "2.0",
- "2.2",
- "2.3",
- "2.5",
- "2.6"
], - "cpu_max_frequency_GHz": [
- "3.5",
- "3.7",
- "3.8",
- "3.5",
- "3.6"
], - "has_local_disk": false,
- "local_disk_size_GB": null,
- "local_num_of_disks": null,
- "local_disk_throughput_MB": null,
- "machine_price_ycu": 2.5
}, - "machine_volume_conf": {
- "volume_conf_id": 2,
- "name": "volume_gcp_2",
- "size": 375,
- "machine_volume_num": 2,
- "machine_volume_strip_num": 2
}
}, - "spark_infra_version": {
- "spark_infra_version_id": 1,
- "spark_docker_image_name": "v3.2.2-20",
- "spark_version": "3.2.2",
- "hive_version": "3.2.3",
- "hadoop_version": "3.2.4",
- "scala_version": "2.12.15",
- "python_version": "3.9.5",
- "notebook_support": true,
- "has_cuda_support": true
}, - "engine_cluster_spark_config": {
- "max_parallel_spark_job_execution_per_instance": 5,
- "standalone_workers_number": null
}
}
}, - "workflow_job_instance_details": {
- "workflow_job_instance_status": {
- "workflow_job_instance_id": 356,
- "workflow_job_id": 356,
- "status": "DONE",
- "from_date": "2024-06-21T09:13:47.789222+00:00",
- "to_date": "2024-06-21T09:20:26.56676+00:00"
}, - "workflow_execution_process": {
- "machine_pid_number": "1964",
- "machine_hostname": "yeedu13-c9b7944b-b5c1-33ad-6055-78cc47b1769a",
- "machine_id": "c9b7944b-b5c1-33ad-6055-78cc47b1769a",
- "machine_pid_user": "root",
- "machine_node_number": "0"
}
}, - "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-21T09:13:47.789222+00:00",
- "from_date": "2024-06-21T09:13:47.789222+00:00",
- "to_date": "2024-06-21T09:20:26.56676+00:00"
}
Start or get the kernel status of a notebook instance.
Start or retrieve the kernel status for a notebook instance, provided the instance is in the RUNNING state.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
notebook_id required | integer <int64> Specifies the ID of the notebook instance for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "notebook_id": 301,
- "kernel_info": {
- "kernel_id": "d08a7416-6aa5-4a92-90db-b8257c324db5",
- "kernel_status": "starting"
}
}
Create a WebSocket proxy for a notebook instance.
Creates a proxy to establish a WebSocket connection for a specific notebook instance, provided the instance is in the RUNNING state.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
notebook_id required | integer <int64> Specifies the ID of the notebook instance for filtering. |
query Parameters
yeedu_session required | string Specifies the session token for Yeedu authentication. |
Responses
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "message": "Created Proxy for Notebook Instance Id: 108."
}
Get the kernel status for a specific notebook instance.
Retrieves the kernel status of a notebook instance, provided the instance is in the RUNNING state.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
notebook_id required | integer <int64> Specifies the ID of the notebook instance for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "kernel_id": "86d10c83-95a6-4fa7-9402-0bc752b925fe",
- "language_name": "python3",
- "kernel_status": "starting",
- "active_connections": 0,
- "last_activity": "2023-08-17T08:02:33.518253Z"
}
Interrupt a notebook instance kernel.
Interrupts the kernel for a specific notebook instance, provided the instance is in the RUNNING state.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
notebook_id required | integer <int64> Specifies the ID of the notebook instance for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "notebook_id": 301,
- "kernel_info": {
- "kernel_id": "d08a7416-6aa5-4a92-90db-b8257c324db5",
- "kernel_status": "starting"
}
}
Restart a notebook instance kernel.
Restarts the kernel for a specific notebook instance, provided the instance is in the RUNNING state.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
notebook_id required | integer <int64> Specifies the ID of the notebook instance for filtering. |
Responses
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "notebook_id": 301,
- "kernel_info": {
- "kernel_id": "d08a7416-6aa5-4a92-90db-b8257c324db5",
- "kernel_status": "busy"
}
}
Stop a notebook instance.
A notebook instance can only be stopped if its status is SUBMITTED or RUNNING.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
notebook_id required | integer <int64> Specifies the ID of the notebook instance to stop. |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "SparkKill": {
- "workflow_job_id": 354,
- "workflow_job_instance_id": 354,
- "spark_job_instance_id": 298,
- "spark_job_id": 23,
- "compute_engine_id": 13
}
}
Download notebook instance logs.
Retrieve stdout or stderr log files of a notebook instance.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
notebook_id required | integer <int64> Specifies the ID of the notebook instance for filtering. |
log_type required | string Enum: "stdout" "stderr" The type of log file to filter. |
Responses
Response samples
- 400
- 401
- 404
- 500
{- "error_code": "string",
- "error_message": "string"
}
Get workflow errors of a notebook instance.
Retrieve workflow errors for a specific notebook instance.
Authorizations:
path Parameters
workspace_id required | integer <int64> Specifies the ID of the workspace for filtering. |
notebook_id required | integer <int64> Specifies the ID of the notebook instance for filtering. |
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "error": "OnError(Process finish with exit code 137,None,None,None,Some(akka.stream.alpakka.amqp.impl.AmqpSourceStage$$anon$1$$anon$2$$anon$3@47b8c55f))"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 10
}
}
Get all the billed tenants.
Retrieves a list of billed tenants.
Authorizations:
query Parameters
billing required | string Default: "invoice" Enum: "invoice" "usage" Specifies the billing type to be used as a filter. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "tenant_id": "34f5c98e-f430-457b-a812-92637d0c6fd0",
- "tenant_name": "string"
}
]
Get all the billed date range.
Retrieves a list of billed date range.
Authorizations:
query Parameters
billing required | string Default: "invoice" Enum: "invoice" "usage" Specifies the billing type to be used as a filter. |
tenant_ids | Array of strings <uuid> [ items <uuid > ] Specifies the tenant IDs to be used as a filter. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "months": [
- "2019-08-24"
]
}
Get all the billed clusters.
Retrieves a list of billed clusters.
Authorizations:
query Parameters
billing required | string Default: "invoice" Enum: "invoice" "usage" Specifies the billing type to be used as a filter. |
tenant_ids | Array of strings <uuid> [ items <uuid > ] Specifies the tenant IDs to be used as a filter. |
cloud_providers | Array of strings Items Enum: "GCP" "AWS" "Azure" Specifies the cloud providers to be used as a filter. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "cluster_id": 1,
- "cluster_name": "yeedu_cluster",
- "tenant_id": "34f5c98e-f430-457b-a812-92637d0c6fd0",
- "tenant_name": "test_tenant",
- "cloud_provider_id": 0,
- "cloud_provider_name": "GCP"
}
]
Get all the billed machine types.
Retrieves a list of billed machine types.
Authorizations:
query Parameters
billing required | string Default: "invoice" Enum: "invoice" "usage" Specifies the billing type to be used as a filter. |
tenant_ids | Array of strings <uuid> [ items <uuid > ] Specifies the tenant IDs to be used as a filter. |
cloud_providers | Array of strings Items Enum: "GCP" "AWS" "Azure" Specifies the cloud providers to be used as a filter. |
cluster_ids | Array of integers <int64> unique [ items <int64 > ] Specifies the cluster instance IDs to be used as a filter. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "machine_type_id": 1,
- "machine_type_name": "n1-highcpu-16"
}
]
Get all the cluster labels for billing.
Retrieves a list of billed cluster labels.
Authorizations:
query Parameters
billing required | string Default: "invoice" Enum: "invoice" "usage" Specifies the billing type to be used as a filter. |
tenant_ids | Array of strings <uuid> [ items <uuid > ] Specifies the tenant IDs to be used as a filter. |
cloud_providers | Array of strings Items Enum: "GCP" "AWS" "Azure" Specifies the cloud providers to be used as a filter. |
cluster_ids | Array of integers <int64> unique [ items <int64 > ] Specifies the cluster instance IDs to be used as a filter. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "key1": [
- "value1",
- "value2",
- "value3"
], - "key2": [
- "value1",
- "value2",
- "value3"
]
}
Get the billing invoice data
Retrieves a list of billed invoices for a specified period.
Authorizations:
query Parameters
tenant_ids | Array of strings <uuid> [ items <uuid > ] Specifies the tenant IDs to be used as a filter. |
start_month_year required | string <date> Specifies the starting month & year (YYYY-MM-DD) to be used as a filter. |
end_month_year required | string <date> Specifies the ending month & year (YYYY-MM-DD) to be used as a filter. |
cloud_providers | Array of strings Items Enum: "GCP" "AWS" "Azure" Specifies the cloud providers to be used as a filter. |
cluster_ids | Array of integers <int64> unique [ items <int64 > ] Specifies the cluster instance IDs to be used as a filter. |
machine_type_ids | Array of integers <int64> unique [ items <int64 > ] Specifies the machine type IDs to be used as a filter. |
labels | object Specifies the labels to be used as a filter. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "invoice": [
- {
- "tenant_id": "d75e0352-bf43-4e9b-9b2f-8b5e924854fd",
- "tenant_name": "test_billing",
- "cluster_id": 2,
- "cluster_name": "yeedu_gcp_instance",
- "cluster_labels": {
- "env": "test_billing",
- "resource": "yeedu",
- "vm": "yeedu_node",
- "tenant_id": "d75e0352-bf43-4e9b-9b2f-8b5e924854fd"
}, - "cloud_provider_id": 0,
- "cloud_provider_name": "GCP",
- "machine_type_id": 10,
- "machine_type": "n1-standard-4",
- "machine_price_ycu_hour": 2.5,
- "total_monthly_minutes": 236,
- "total_monthly_ycu": 9.833333333333334,
- "checkpoint_month": "2024-04-30T18:30:00+00:00",
- "from_date": "2024-05-30T10:23:44.952719+00:00",
- "to_date": "infinity"
}, - {
- "tenant_id": "c5b2ade3-2385-4dbe-95d7-1fb4c373dc44",
- "tenant_name": "ui_dev_tenant",
- "cluster_id": 1,
- "cluster_name": "gcp_test_cluster",
- "cluster_labels": {
- "resource": "yeedu",
- "vm": "yeedu_node",
- "tenant_id": "c5b2ade3-2385-4dbe-95d7-1fb4c373dc44"
}, - "cloud_provider_id": 0,
- "cloud_provider_name": "GCP",
- "machine_type_id": 10,
- "machine_type": "n1-standard-4",
- "machine_price_ycu_hour": 2.5,
- "total_monthly_minutes": 440,
- "total_monthly_ycu": 18.333333333333332,
- "checkpoint_month": "2024-04-30T18:30:00+00:00",
- "from_date": "2024-05-30T10:23:44.952719+00:00",
- "to_date": "infinity"
}, - {
- "tenant_id": "c5b2ade3-2385-4dbe-95d7-1fb4c373dc44",
- "tenant_name": "ui_dev_tenant",
- "cluster_id": 1,
- "cluster_name": "gcp_test_cluster",
- "cluster_labels": {
- "resource": "yeedu",
- "vm": "yeedu_node",
- "tenant_id": "c5b2ade3-2385-4dbe-95d7-1fb4c373dc44"
}, - "cloud_provider_id": 0,
- "cloud_provider_name": "GCP",
- "machine_type_id": 10,
- "machine_type": "n1-standard-4",
- "machine_price_ycu_hour": 2.5,
- "total_monthly_minutes": 86,
- "total_monthly_ycu": 3.583333333333333,
- "checkpoint_month": "2024-05-01T00:00:00+00:00",
- "from_date": "2024-05-30T10:23:44.952719+00:00",
- "to_date": "infinity"
}, - {
- "tenant_id": "d75e0352-bf43-4e9b-9b2f-8b5e924854fd",
- "tenant_name": "test_billing",
- "cluster_id": 3,
- "cluster_name": "yeedu_aws_instance",
- "cluster_labels": {
- "env": "billing_test",
- "resource": "yeedu",
- "vm": "yeedu_node",
- "tenant_id": "d75e0352-bf43-4e9b-9b2f-8b5e924854fd"
}, - "cloud_provider_id": 1,
- "cloud_provider_name": "AWS",
- "machine_type_id": 89,
- "machine_type": "m5d.xlarge",
- "machine_price_ycu_hour": 2.6,
- "total_monthly_minutes": 234,
- "total_monthly_ycu": 10.14,
- "checkpoint_month": "2024-04-30T18:30:00+00:00",
- "from_date": "2024-05-30T10:23:44.952719+00:00",
- "to_date": "infinity"
}, - {
- "tenant_id": "d75e0352-bf43-4e9b-9b2f-8b5e924854fd",
- "tenant_name": "test_billing",
- "cluster_id": 4,
- "cluster_name": "yeedu_azure_instance",
- "cluster_labels": {
- "test": "billing",
- "resource": "yeedu",
- "vm": "yeedu_node",
- "tenant_id": "d75e0352-bf43-4e9b-9b2f-8b5e924854fd"
}, - "cloud_provider_id": 2,
- "cloud_provider_name": "Azure",
- "machine_type_id": 206,
- "machine_type": "Standard_D4d_v5",
- "machine_price_ycu_hour": 2.6,
- "total_monthly_minutes": 3,
- "total_monthly_ycu": 0.13,
- "checkpoint_month": "2024-04-30T18:30:00+00:00",
- "from_date": "2024-05-30T10:23:44.952719+00:00",
- "to_date": "infinity"
}, - {
- "tenant_id": "d75e0352-bf43-4e9b-9b2f-8b5e924854fd",
- "tenant_name": "test_billing",
- "cluster_id": 5,
- "cluster_name": "azure_test",
- "cluster_labels": {
- "resource": "yeedu",
- "vm": "yeedu_node",
- "tenant_id": "d75e0352-bf43-4e9b-9b2f-8b5e924854fd"
}, - "cloud_provider_id": 2,
- "cloud_provider_name": "Azure",
- "machine_type_id": 206,
- "machine_type": "Standard_D4d_v5",
- "machine_price_ycu_hour": 2.6,
- "total_monthly_minutes": 3,
- "total_monthly_ycu": 0.13,
- "checkpoint_month": "2024-04-30T18:30:00+00:00",
- "from_date": "2024-05-30T10:23:44.952719+00:00",
- "to_date": "infinity"
}
], - "invoice_overview": {
- "overall_total_minutes": 1002,
- "overall_total_ycu": 42.15,
- "total_clusters_count": 5,
- "total_tenants": 2
}
}
Get the billing usage data
Retrieves a list of billed usage data for a specified period.
Authorizations:
query Parameters
tenant_ids | Array of strings <uuid> [ items <uuid > ] Specifies the tenant IDs to be used as a filter. |
start_date required | string <date> Specifies the starting date (YYYY-MM-DD) to be used as a filter. |
end_date required | string <date> Specifies the ending date (YYYY-MM-DD) to be used as a filter. |
cloud_providers | Array of strings Items Enum: "GCP" "AWS" "Azure" Specifies the cloud providers to be used as a filter. |
cluster_ids | Array of integers <int64> unique [ items <int64 > ] Specifies the cluster instance IDs to be used as a filter. |
machine_type_ids | Array of integers <int64> unique [ items <int64 > ] Specifies the machine type IDs to be used as a filter. |
labels | object Specifies the labels to be used as a filter. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "usage": [
- {
- "tenant_id": "d75e0352-bf43-4e9b-9b2f-8b5e924854fd",
- "tenant_name": "test_billing",
- "cluster_id": 2,
- "cluster_name": "yeedu_gcp_instance",
- "cluster_labels": {
- "env": "test_billing",
- "resource": "yeedu",
- "vm": "yeedu_node",
- "tenant_id": "d75e0352-bf43-4e9b-9b2f-8b5e924854fd"
}, - "cloud_provider_id": 0,
- "cloud_provider_name": "GCP",
- "machine_type_id": 10,
- "machine_type": "n1-standard-4",
- "machine_price_ycu_hour": 2.5,
- "total_daily_minutes": 236,
- "total_daily_ycu": 9.833333333333334,
- "checkpoint_day": "2024-05-29T18:30:00+00:00",
- "from_date": "2024-05-30T10:23:47.447166+00:00",
- "to_date": "infinity"
}, - {
- "tenant_id": "c5b2ade3-2385-4dbe-95d7-1fb4c373dc44",
- "tenant_name": "ui_dev_tenant",
- "cluster_id": 1,
- "cluster_name": "gcp_test_cluster",
- "cluster_labels": {
- "resource": "yeedu",
- "vm": "yeedu_node",
- "tenant_id": "c5b2ade3-2385-4dbe-95d7-1fb4c373dc44"
}, - "cloud_provider_id": 0,
- "cloud_provider_name": "GCP",
- "machine_type_id": 10,
- "machine_type": "n1-standard-4",
- "machine_price_ycu_hour": 2.5,
- "total_daily_minutes": 440,
- "total_daily_ycu": 18.333333333333332,
- "checkpoint_day": "2024-05-29T18:30:00+00:00",
- "from_date": "2024-05-30T10:23:47.447166+00:00",
- "to_date": "infinity"
}, - {
- "tenant_id": "d75e0352-bf43-4e9b-9b2f-8b5e924854fd",
- "tenant_name": "test_billing",
- "cluster_id": 3,
- "cluster_name": "yeedu_aws_instance",
- "cluster_labels": {
- "env": "billing_test",
- "resource": "yeedu",
- "vm": "yeedu_node",
- "tenant_id": "d75e0352-bf43-4e9b-9b2f-8b5e924854fd"
}, - "cloud_provider_id": 1,
- "cloud_provider_name": "AWS",
- "machine_type_id": 89,
- "machine_type": "m5d.xlarge",
- "machine_price_ycu_hour": 2.6,
- "total_daily_minutes": 234,
- "total_daily_ycu": 10.14,
- "checkpoint_day": "2024-05-29T18:30:00+00:00",
- "from_date": "2024-05-30T10:23:47.447166+00:00",
- "to_date": "infinity"
}, - {
- "tenant_id": "d75e0352-bf43-4e9b-9b2f-8b5e924854fd",
- "tenant_name": "test_billing",
- "cluster_id": 4,
- "cluster_name": "yeedu_azure_instance",
- "cluster_labels": {
- "test": "billing",
- "resource": "yeedu",
- "vm": "yeedu_node",
- "tenant_id": "d75e0352-bf43-4e9b-9b2f-8b5e924854fd"
}, - "cloud_provider_id": 2,
- "cloud_provider_name": "Azure",
- "machine_type_id": 206,
- "machine_type": "Standard_D4d_v5",
- "machine_price_ycu_hour": 2.6,
- "total_daily_minutes": 3,
- "total_daily_ycu": 0.13,
- "checkpoint_day": "2024-05-29T18:30:00+00:00",
- "from_date": "2024-05-30T10:23:47.447166+00:00",
- "to_date": "infinity"
}, - {
- "tenant_id": "d75e0352-bf43-4e9b-9b2f-8b5e924854fd",
- "tenant_name": "test_billing",
- "cluster_id": 5,
- "cluster_name": "azure_test",
- "cluster_labels": {
- "resource": "yeedu",
- "vm": "yeedu_node",
- "tenant_id": "d75e0352-bf43-4e9b-9b2f-8b5e924854fd"
}, - "cloud_provider_id": 2,
- "cloud_provider_name": "Azure",
- "machine_type_id": 206,
- "machine_type": "Standard_D4d_v5",
- "machine_price_ycu_hour": 2.6,
- "total_daily_minutes": 3,
- "total_daily_ycu": 0.13,
- "checkpoint_day": "2024-05-29T18:30:00+00:00",
- "from_date": "2024-05-30T10:23:47.447166+00:00",
- "to_date": "infinity"
}
], - "usage_overview": {
- "overall_total_minutes": 916,
- "overall_total_ycu": 38.56666666666667,
- "total_clusters_count": 5,
- "total_tenants": 2
}
}
Generate yeedu session token
Generates a yeedu session token based on the provided login details to access the resources
Request Body schema: application/jsonrequired
Login details to generate session token
username | string non-empty |
password | string <password> non-empty |
timeout | string non-empty |
auth_type required | string Enum: "LDAP" "AAD" "AZURE_SSO" |
redirect_url | string or null non-empty |
Responses
Request samples
- Payload
{- "username": "USER",
- "password": "PASS",
- "timeout": "48",
- "auth_type": "LDAP",
- "redirect_url": "https:example.com/login-redirect"
}
Response samples
- 200
- 400
- 404
- 500
{- "token": "eyJhbGciOiJIuZI1nIIsInR5cCI6IkpXVCJ9.eyJ1c2VybmFtZSI6InVzMjYxMCIsImlhdCI6MTY2NDc4NjQ2OSwiZXhwIjoxnJy0OdCyODy5fQ.WsBh8n_u-Y88edEZiMfWswviEEsgiL4_2Eu_5ZCGuOQ"
}
Callback URL for Azure AD user authentication.
This endpoint serves as the callback URL invoked by Azure Active Directory (Azure AD) after a successful user login.
Responses
Response samples
- 200
- 400
- 401
- 403
- 404
- 500
{- "token": "eyJhbGciOiJIuZI1nIIsInR5cCI6IkpXVCJ9.eyJ1c2VybmFtZSI6InVzMjYxMCIsImlhdCI6MTY2NDc4NjQ2OSwiZXhwIjoxnJy0OdCyODy5fQ.WsBh8n_u-Y88edEZiMfWswviEEsgiL4_2Eu_5ZCGuOQ"
}
Get all the User Tenants
All Tenant Ids available for a specific user are returned in the form of JSON
Authorizations:
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "tenant_id": "ffafef39-1948-4cd2-81b0-8243eadf6f75",
- "name": "manual_ui_test",
- "description": null
}, - {
- "tenant_id": "59f0724b-d711-47ab-8010-497f1f715735",
- "name": "integration_test_tenant",
- "description": "Creating_tenant_integration_test_tenant"
}, - {
- "tenant_id": "cf1f945f-01ce-4ac6-a070-8c733f2fa791",
- "name": "ui_testing",
- "description": "creating tenant ui_testing"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 3,
- "total_pages": 1,
- "limit": 100
}
}
Search tenant across the user tenants
All Tenant available for a specific user are returned based on the tenant name
Authorizations:
query Parameters
tenant_name required | string The tenant name that will be used for filtering |
pageNumber | integer <int32> Default: 1 The page number from which items will return |
limit | integer <int32> Default: 100 The numbers of items to return |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "tenant_id": "ffafef39-1948-4cd2-81b0-8243eadf6f75",
- "name": "manual_ui_test",
- "description": null
}, - {
- "tenant_id": "59f0724b-d711-47ab-8010-497f1f715735",
- "name": "integration_test_tenant",
- "description": "Creating_tenant_integration_test_tenant"
}, - {
- "tenant_id": "cf1f945f-01ce-4ac6-a070-8c733f2fa791",
- "name": "ui_testing",
- "description": "creating tenant ui_testing"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 3,
- "total_pages": 1,
- "limit": 100
}
}
Associate a tenant Id with the current session.
Associate the tenant Id with the session token.
Authorizations:
path Parameters
tenant_id required | string <uuid> Tenant Id that will be used to associate |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "Successfully associated Tenant"
}
Get all the User Information
User information for a specific user are returned in the form of JSON
Authorizations:
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "user_id": "2",
- "tenant_id": "be7da193-7c44-429a-8631-8a60567ae6a2",
- "username": "USER",
- "email": "user@yeedu.io",
- "group_info": [
- {
- "group_id": 1,
- "groupname": "Data_Engineering",
- "group_type": "Unified"
}, - {
- "group_id": 2,
- "groupname": "Data_Curation",
- "group_type": "DynamicMembership"
}
], - "from_date": "2024-06-14T10:11:02.278Z",
- "to_date": null
}
Get User Roles for a specific session
User roles are returned across all tenants if the tenant_id is not provided.
Authorizations:
query Parameters
tenant_id | string <uuid> Tenant ID that will be used to get the user roles within it. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "user_id": 4,
- "username": "ru0000-yeedu@yeedu.io",
- "email": "ru0000-yeedu@yeedu.io",
- "user_roles": [
- {
- "roles_id": 0,
- "user_role": "User"
}
], - "group_roles": null,
- "from_date": "2024-06-14T10:11:02.278675+00:00",
- "to_date": "infinity"
}
Get all the Users in a tenant
All the users present in a tenant are returned in the form of JSON
Authorizations:
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "user_id": 13,
- "username": "ru0002-yeedu@yeedu.io",
- "display_name": "RU0001",
- "email": "ru0002-yeedu@yeedu.io"
}, - {
- "user_id": 12,
- "username": "ru0001-yeedu@yeedu.io",
- "display_name": "RU0001",
- "email": "ru0001-yeedu@yeedu.io"
}, - {
- "user_id": 10,
- "username": "ysu0001-yeedu@yeedu.io",
- "display_name": "YSU0001",
- "email": "ysu0001-yeedu@yeedu.io"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 3,
- "total_pages": 1,
- "limit": 100
}
}
Search all the Users by username in a tenant
Search all the users present in a tenant by username
Authorizations:
query Parameters
username required | string Username that will be used for filter |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "user_id": 13,
- "username": "ru0002-yeedu@yeedu.io",
- "display_name": "RU0001",
- "email": "ru0002-yeedu@yeedu.io"
}, - {
- "user_id": 12,
- "username": "ru0001-yeedu@yeedu.io",
- "display_name": "RU0001",
- "email": "ru0001-yeedu@yeedu.io"
}, - {
- "user_id": 10,
- "username": "ysu0001-yeedu@yeedu.io",
- "display_name": "YSU0001",
- "email": "ysu0001-yeedu@yeedu.io"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 3,
- "total_pages": 1,
- "limit": 100
}
}
Get User Details for a specific User Id
User details are filtered for a specific User Id and returned in the form of JSON
Authorizations:
path Parameters
user_id required | integer <int64> User Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "user_id": 12,
- "username": "ru0001-yeedu@yeedu.io",
- "display_name": "RU0001",
- "email": "ru0001-yeedu@yeedu.io",
- "from_date": "2024-06-20T10:38:48.746144+00:00",
- "to_date": "infinity"
}
Get all the User Roles for a specific User Id
User roles are filtered for a specific User Id and returned in the form of JSON
Authorizations:
path Parameters
user_id required | integer <int64> User Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "user_id": 11,
- "username": "ysu0002-yeedu@yeedu.io",
- "email": "ysu0002-yeedu@yeedu.io",
- "user_roles": null,
- "group_roles": [
- {
- "group_id": 355,
- "group_name": "G_Yeedu_Infra",
- "group_mail": null,
- "group_object_id": "e56deqwaa-554f-485f-awdac-e409wda8f0",
- "group_type": null,
- "role_id": 4,
- "group_role": "Platform Billing"
}
], - "from_date": "2024-06-20T10:27:04.892889+00:00",
- "to_date": "infinity"
}
Get all the Users and it's respective roles in a tenant
All the Users and it's respective roles in a tenant are returned in the form of JSON
Authorizations:
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io",
- "user_roles": [
- "Admin",
- "Platform Admin"
], - "group_roles": [
- null
]
}, - {
- "user_id": 2,
- "username": "ya0000-yeedu@yeedu.io",
- "user_roles": [
- "Admin"
], - "group_roles": [
- null
]
}, - {
- "user_id": 3,
- "username": "rp0000-yeedu@yeedu.io",
- "user_roles": [
- "Can Manage Cluster"
], - "group_roles": [
- null
]
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 3,
- "total_pages": 1,
- "limit": 2
}
}
Get all the Users for a specific Role Id
Users are filtered for a specific Role Id and returned in the form of JSON
Authorizations:
path Parameters
role_id required | integer <int64> Role Id that will be used for filter |
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": {
- "role_id": 2,
- "users": [
- {
- "user_id": 2,
- "username": "ya0000-yeedu@yeedu.io",
- "display_name": "ya0000-yeedu",
- "email": "ya0000-yeedu@yeedu.io"
}, - {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io",
- "display_name": "ysu0000-yeedu",
- "email": "ysu0000-yeedu@yeedu.io"
}
]
}, - "result_set": {
- "current_page": 1,
- "total_objects": 2,
- "total_pages": 1,
- "limit": 100
}
}
Get all the Groups in a tenant
All the groups present in a tenant are returned in the form of JSON
Authorizations:
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "group_id": 602,
- "group_name": "G_Yeedu_Auditor",
- "group_mail": null,
- "group_object_id": "ba7d4601-2342-43d800",
- "group_type": null
}, - {
- "group_id": 355,
- "group_name": "G_Yeedu_Infra",
- "group_mail": null,
- "group_object_id": "e4d02b7-e80d409b48f0",
- "group_type": null
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 2,
- "total_pages": 1,
- "limit": 100
}
}
Search all the Groups by groupname in a tenant
Search all the Groups by groupname in a tenant
Authorizations:
query Parameters
groupname required | string Group name that will be used for filter |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "group_id": 602,
- "group_name": "G_Yeedu_Auditor",
- "group_mail": null,
- "group_object_id": "ba7d4601-2342-43d800",
- "group_type": null
}, - {
- "group_id": 355,
- "group_name": "G_Yeedu_Infra",
- "group_mail": null,
- "group_object_id": "e4d02b7-e80d409b48f0",
- "group_type": null
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 2,
- "total_pages": 1,
- "limit": 100
}
}
Get Group Details for a specific Group Id
Group details are filtered for a specific Group Id and returned in the form of JSON
Authorizations:
path Parameters
group_id required | integer <int64> Group Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "group_id": 602,
- "group_name": "G_Yeedu_Auditor",
- "group_object_id": "ba7d4601-57-a055-953d800",
- "group_type": null,
- "from_date": "2024-06-20T11:25:39.573594+00:00",
- "to_date": "infinity"
}
Get all the Group Roles for a specific Group Id
Group Roles are filtered for a specific Group Id and returned in the form of JSON
Authorizations:
path Parameters
group_id required | integer <int64> Group Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "group_id": 602,
- "group_name": "G_Yeedu_Auditor",
- "group_type": null,
- "roles": [
- "Admin"
]
}
Get all the Groups and it's respective roles
Groups and it's respective roles are returned in the form of JSON
Authorizations:
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "group_id": 117,
- "group_name": "G_Yeedu_Manager",
- "group_mail": null,
- "group_type": null,
- "group_object_id": "bbdfd-c33a129d36d4",
- "roles": [
- "Can Manage Cluster"
]
}, - {
- "group_id": 167,
- "group_name": "G_Yeedu_Infra",
- "group_mail": null,
- "group_type": "Unified",
- "group_object_id": "ff35e0aa-a29cb5cb8415",
- "roles": [
- "Platform Billing"
]
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 5,
- "total_pages": 3,
- "limit": 2,
- "next_page": 2
}
}
Get all the Groups for a specific Role Id
Groups are filtered for a specific Role Id and returned in the form of JSON
Authorizations:
path Parameters
role_id required | integer <int64> Role Id that will be used for filter |
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": {
- "role_id": 2,
- "groups": [
- {
- "group_id": 602,
- "group_name": "G_Yeedu_Auditor",
- "group_mail": null,
- "group_object_id": "ba7d4601-2342-aeb953d800",
- "group_type": null
}
]
}, - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 100
}
}
Create a new User Role
Rules to assign a role to an user
- Platform Admin Role cannot be assigned to any user.
- Can assign all other roles to an user.
Authorizations:
path Parameters
user_id required | integer <int64> User Id that will be used for adding role |
role_id required | integer <int64> Role Id that will be used for adding role |
Responses
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "user_roles_id": "36",
- "tenant_id": "9d6d3054-a5f6-4dbf-86f9-26989eb73ed3",
- "user_id": "9",
- "role_id": 2,
- "created_by_user_id": "2",
- "modified_by_user_id": "2",
- "last_update_date": "2024-06-21T17:03:17.197Z",
- "from_date": "2024-06-21T17:03:17.197Z",
- "to_date": null
}
Delete an existing User Role for a specific User Id and Role Id
Rules to delete a role of an user
- Cannot delete a Platform Admin Role of any user.
- Cannot delete an Admin Role for itself.
- But can delete an Admin Role for other Admin users.
- Can delete all the other roles for a user.
Authorizations:
path Parameters
user_id required | integer <int64> User Id that will be used for deleting role |
role_id required | integer <int64> Role Id that will be used for deleting role |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "Deleted User Roles for the provided User Id: 9 and Role Id: 2"
}
Create a new Group Role
Rules to assign a role to a group
- Platform Admin Role cannot be assigned to any group.
- Can assign all other roles to a group.
Authorizations:
path Parameters
group_id required | integer <int64> Group Id that will be used for adding role |
role_id required | integer <int64> Role Id that will be used for adding role |
Responses
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "group_roles_id": "11",
- "tenant_id": "9d6d3054-a5f6-4dbf-86f9-26989eb73ed3",
- "group_id": "117",
- "role_id": 2,
- "created_by_user_id": "2",
- "modified_by_user_id": "2",
- "last_update_date": "2024-06-21T17:06:23.498Z",
- "from_date": "2024-06-21T17:06:23.498Z",
- "to_date": null
}
Delete an existing Group Role for a specific Group Id and Role Id
Rules to delete a role of a group
- Cannot delete a Platform Admin Role of any group.
- Cannot delete an Admin Role for its own group.
- But can delete an Admin Role for other Admin groups.
- Can delete all the other roles for a group.
Authorizations:
path Parameters
group_id required | integer <int64> Group Id that will be used for deleting role |
role_id required | integer <int64> Role Id that will be used for deleting role |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "Deleted Group Role for the provided group ID: 117, and role ID: 2"
}
Get all the Tenants
Tenant details are returned in the form of JSON
Authorizations:
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "data": [
- {
- "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "name": "test",
- "description": null,
- "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-20T17:16:28.24551+00:00",
- "from_date": "2024-06-20T17:16:28.24551+00:00",
- "to_date": "infinity"
}
], - "result_set": null,
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 100
}
]
Get all the Tenants matching with the tenant name
Tenant details matching with the tenant name are returned in the form of JSON
Authorizations:
query Parameters
tenant_name required | string Tenant name that will be used for filter |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "data": [
- {
- "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "name": "test",
- "description": null,
- "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-20T17:16:28.24551+00:00",
- "from_date": "2024-06-20T17:16:28.24551+00:00",
- "to_date": "infinity"
}
], - "result_set": null,
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 100
}
]
Create a new Tenant
Creates a new Tenant with provided Tenant Configuration
Authorizations:
Request Body schema: application/jsonrequired
The Tenant to be added
name required | string non-empty The
|
description | string or null non-empty |
Responses
Request samples
- Payload
{- "name": "tenant",
- "description": "Tenant description"
}
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "tenant_id": "a6ca4076-575a-45b0-a6e9-9e54e1940d23",
- "name": "test",
- "description": null,
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T17:18:54.215Z",
- "from_date": "2024-06-21T17:18:54.215Z",
- "to_date": null
}
Get Tenant Details for a specific Tenant Id or Name
Tenant details are filtered for a specific Tenant Id or Name and returned in the form of JSON
Authorizations:
query Parameters
tenant_id | string <uuid> Tenant Id that will be used for filter |
tenant_name | string Tenant Name that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "tenant_id": "49a8817e-8b8e-4d76-a717-c33db6f7e018",
- "name": "test",
- "description": null,
- "created_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "modified_by": {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io"
}, - "last_update_date": "2024-06-20T17:16:28.24551+00:00",
- "from_date": "2024-06-20T17:16:28.24551+00:00",
- "to_date": "infinity"
}
], - "result_set": null,
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 100
}
Update an existing Tenant for a specific Tenant Id or Name
Authorizations:
query Parameters
tenant_id | string <uuid> Tenant Id that will be used for Modification |
tenant_name | string Tenant Name that will be used for Modification |
Request Body schema: application/jsonrequired
The Tenant to be modified
name | string non-empty The
|
description | string or null non-empty |
Responses
Request samples
- Payload
{- "name": "test_2",
- "description": "test_tenant"
}
Response samples
- 201
- 400
- 401
- 403
- 404
- 409
- 500
{- "tenant_id": "a6ca4076-575a-45b0-a6e9-9e54e1940d23",
- "name": "test",
- "description": null,
- "created_by_user_id": "1",
- "modified_by_user_id": "1",
- "last_update_date": "2024-06-21T17:18:54.215Z",
- "from_date": "2024-06-21T17:18:54.215Z",
- "to_date": null
}
Delete an existing Tenant for a specific Tenant Id or Name
Authorizations:
query Parameters
tenant_id | string <uuid> Tenant Id that will be used for Deletion |
tenant_name | string Tenant Name that will be used for Deletion |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "Deleted tenant id: a6ca4076-575a-45b0-a6e9-9e54e1940d23."
}
Get all the Users in a Tenant
All the users present in a tenant are returned in the form of JSON
Authorizations:
path Parameters
tenant_id required | string <uuid> Tenant Id that will be used for filter |
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "user_id": 13,
- "username": "ru0002-yeedu@yeedu.io",
- "display_name": "RU0001",
- "email": "ru0002-yeedu@yeedu.io"
}, - {
- "user_id": 12,
- "username": "ru0001-yeedu@yeedu.io",
- "display_name": "RU0001",
- "email": "ru0001-yeedu@yeedu.io"
}, - {
- "user_id": 10,
- "username": "ysu0001-yeedu@yeedu.io",
- "display_name": "YSU0001",
- "email": "ysu0001-yeedu@yeedu.io"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 3,
- "total_pages": 1,
- "limit": 100
}
}
Search all the users by username in a Tenant
Search all the users by username present in a tenant
Authorizations:
path Parameters
tenant_id required | string <uuid> Tenant Id that will be used for filter |
query Parameters
username required | string Username that will be used for filter |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "user_id": 13,
- "username": "ru0002-yeedu@yeedu.io",
- "display_name": "RU0001",
- "email": "ru0002-yeedu@yeedu.io"
}, - {
- "user_id": 12,
- "username": "ru0001-yeedu@yeedu.io",
- "display_name": "RU0001",
- "email": "ru0001-yeedu@yeedu.io"
}, - {
- "user_id": 10,
- "username": "ysu0001-yeedu@yeedu.io",
- "display_name": "YSU0001",
- "email": "ysu0001-yeedu@yeedu.io"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 3,
- "total_pages": 1,
- "limit": 100
}
}
Get all the Groups in a Tenant
All the groups present in a tenant are returned in the form of JSON
Authorizations:
path Parameters
tenant_id required | string <uuid> Tenant Id that will be used for filter |
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "group_id": 602,
- "group_name": "G_Yeedu_Auditor",
- "group_mail": null,
- "group_object_id": "ba7d4601-2342-43d800",
- "group_type": null
}, - {
- "group_id": 355,
- "group_name": "G_Yeedu_Infra",
- "group_mail": null,
- "group_object_id": "e4d02b7-e80d409b48f0",
- "group_type": null
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 2,
- "total_pages": 1,
- "limit": 100
}
}
Search all the Groups by groupname in a Tenant
Search all the Groups by groupname in a Tenant are returned in the form of JSON
Authorizations:
path Parameters
tenant_id required | string <uuid> Tenant Id that will be used for filter |
query Parameters
groupname required | string Group name that will be used for filter |
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "group_id": 602,
- "group_name": "G_Yeedu_Auditor",
- "group_mail": null,
- "group_object_id": "ba7d4601-2342-43d800",
- "group_type": null
}, - {
- "group_id": 355,
- "group_name": "G_Yeedu_Infra",
- "group_mail": null,
- "group_object_id": "e4d02b7-e80d409b48f0",
- "group_type": null
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 2,
- "total_pages": 1,
- "limit": 100
}
}
Get User Details for a specific Tenant Id and User Id
User details are filtered for a specific Tenant Id along with User Id and returned in the form of JSON
Authorizations:
path Parameters
tenant_id required | string <uuid> Tenant Id that will be used for filter |
user_id required | integer <int64> User Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "user_id": 12,
- "username": "ru0001-yeedu@yeedu.io",
- "display_name": "RU0001",
- "email": "ru0001-yeedu@yeedu.io",
- "from_date": "2024-06-20T10:38:48.746144+00:00",
- "to_date": "infinity"
}
Get Group Details for a specific Tenant Id and Group Id
Group details are filtered for a specific Tenant Id along with Group Id and returned in the form of JSON
Authorizations:
path Parameters
tenant_id required | string <uuid> Tenant Id that will be used for filter |
group_id required | integer <int64> Group Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "group_id": 602,
- "group_name": "G_Yeedu_Auditor",
- "group_object_id": "ba7d4601-57-a055-953d800",
- "group_type": null,
- "from_date": "2024-06-20T11:25:39.573594+00:00",
- "to_date": "infinity"
}
Get all the Users and it's respective roles in a tenant
All the Users and it's respective roles in a tenant are returned in the form of JSON
Authorizations:
path Parameters
tenant_id required | string <uuid> Tenant Id that will be used for filter |
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io",
- "user_roles": [
- "Admin",
- "Platform Admin"
], - "group_roles": [
- null
]
}, - {
- "user_id": 2,
- "username": "ya0000-yeedu@yeedu.io",
- "user_roles": [
- "Admin"
], - "group_roles": [
- null
]
}, - {
- "user_id": 3,
- "username": "rp0000-yeedu@yeedu.io",
- "user_roles": [
- "Can Manage Cluster"
], - "group_roles": [
- null
]
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 3,
- "total_pages": 1,
- "limit": 2
}
}
Get User Roles for a specific Tenant Id and User Id
User roles are filtered for a specific Tenant Id along with User Id and returned in the form of JSON
Authorizations:
path Parameters
tenant_id required | string <uuid> Tenant Id that will be used for filter |
user_id required | integer <int64> User Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "user_id": 11,
- "username": "ysu0002-yeedu@yeedu.io",
- "email": "ysu0002-yeedu@yeedu.io",
- "user_roles": null,
- "group_roles": [
- {
- "group_id": 355,
- "group_name": "G_Yeedu_Infra",
- "group_mail": null,
- "group_object_id": "e56deqwaa-554f-485f-awdac-e409wda8f0",
- "group_type": null,
- "role_id": 4,
- "group_role": "Platform Billing"
}
], - "from_date": "2024-06-20T10:27:04.892889+00:00",
- "to_date": "infinity"
}
Get Tenants for a specific User Id
Tenants are filtered for a specific User Id and returned in the form of JSON
Authorizations:
path Parameters
user_id required | integer <int64> User Id that will be used for filter |
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "tenant_id": "ffafef39-1948-4cd2-81b0-8243eadf6f75",
- "name": "manual_ui_test",
- "description": null
}, - {
- "tenant_id": "59f0724b-d711-47ab-8010-497f1f715735",
- "name": "integration_test_tenant",
- "description": "Creating_tenant_integration_test_tenant"
}, - {
- "tenant_id": "cf1f945f-01ce-4ac6-a070-8c733f2fa791",
- "name": "ui_testing",
- "description": "creating tenant ui_testing"
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 3,
- "total_pages": 1,
- "limit": 100
}
}
Get all the Groups and it's respective roles
Groups and it's respective roles are returned in the form of JSON
Authorizations:
path Parameters
tenant_id required | string <uuid> Tenant Id that will be used for filter |
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": [
- {
- "group_id": 117,
- "group_name": "G_Yeedu_Manager",
- "group_mail": null,
- "group_type": null,
- "group_object_id": "bbdfd-c33a129d36d4",
- "roles": [
- "Can Manage Cluster"
]
}, - {
- "group_id": 167,
- "group_name": "G_Yeedu_Infra",
- "group_mail": null,
- "group_type": "Unified",
- "group_object_id": "ff35e0aa-a29cb5cb8415",
- "roles": [
- "Platform Billing"
]
}
], - "result_set": {
- "current_page": 1,
- "total_objects": 5,
- "total_pages": 3,
- "limit": 2,
- "next_page": 2
}
}
Get Group Roles for a specific Tenant and Group Id
Group Roles are filtered for a specific Tenant Id along with Group Id and returned in the form of JSON
Authorizations:
path Parameters
tenant_id required | string <uuid> Tenant Id that will be used for filter |
group_id required | integer <int64> Group Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "group_id": 602,
- "group_name": "G_Yeedu_Auditor",
- "group_type": null,
- "roles": [
- "Admin"
]
}
Get Users for a specific Tenant Id and Role Id
Users are filtered for a specific Tenant Id along with Role Id and returned in the form of JSON
Authorizations:
path Parameters
tenant_id required | string <uuid> Tenant Id that will be used for filter |
role_id required | integer <int64> Role Id that will be used for filter |
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": {
- "role_id": 2,
- "users": [
- {
- "user_id": 2,
- "username": "ya0000-yeedu@yeedu.io",
- "display_name": "ya0000-yeedu",
- "email": "ya0000-yeedu@yeedu.io"
}, - {
- "user_id": 1,
- "username": "ysu0000-yeedu@yeedu.io",
- "display_name": "ysu0000-yeedu",
- "email": "ysu0000-yeedu@yeedu.io"
}
]
}, - "result_set": {
- "current_page": 1,
- "total_objects": 2,
- "total_pages": 1,
- "limit": 100
}
}
Get Groups for a specific Tenant Id and Role Id
Groups are filtered for a specific Tenant Id along with Role Id and returned in the form of JSON
Authorizations:
path Parameters
tenant_id required | string <uuid> Tenant Id that will be used for filter |
role_id required | integer <int64> Role Id that will be used for filter |
query Parameters
limit | integer <int32> Default: 100 The numbers of items to return. |
pageNumber | integer <int32> Default: 1 The page number for the items to return. |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
{- "data": {
- "role_id": 2,
- "groups": [
- {
- "group_id": 602,
- "group_name": "G_Yeedu_Auditor",
- "group_mail": null,
- "group_object_id": "ba7d4601-2342-aeb953d800",
- "group_type": null
}
]
}, - "result_set": {
- "current_page": 1,
- "total_objects": 1,
- "total_pages": 1,
- "limit": 100
}
}
Create a new User Role
Rules to assign a role to an user
- If the role_id provided is of platform Admin and tenant_id is NULL then allow to create the role.
- If the role_id provided is of platform Admin and tenant_id is not NULL then do not allow to create the role otherwise the user will be bound to a specific tenant.
- For other role_id the tenant_id will be required.
Authorizations:
path Parameters
user_id required | integer <int64> User Id that will be used for adding role |
role_id required | integer <int64> Role Id that will be used for adding role |
query Parameters
tenant_id | string <uuid> Tenant Id that will be used for adding role |
Responses
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "user_roles_id": "36",
- "tenant_id": "9d6d3054-a5f6-4dbf-86f9-26989eb73ed3",
- "user_id": "9",
- "role_id": 2,
- "created_by_user_id": "2",
- "modified_by_user_id": "2",
- "last_update_date": "2024-06-21T17:03:17.197Z",
- "from_date": "2024-06-21T17:03:17.197Z",
- "to_date": null
}
Delete an existing User Role for a specific Tenant, User and Role Id
Rules to delete a role of an user
- Cannot delete a Platform Admin Role for itself.
- But can delete the Platform Admin Role of other Platform Admin users.
Authorizations:
path Parameters
user_id required | integer <int64> User Id that will be used for deleting role |
role_id required | integer <int64> Role Id that will be used for deleting role |
query Parameters
tenant_id | string <uuid> Tenant Id that will be used for deleting role |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "Deleted User Role for the provided Tenant Id: '83d9056b-a3b3-4eb3-80db-1ed364428b0e', User Id: 2, and Role Id: 1"
}
Create a new Group Role
Rules to assign a role to a group
- Platform Admin Role cannot be assigned to any group.
- Can assign all other roles to a group across tenants.
Authorizations:
path Parameters
group_id required | integer <int64> Group Id that will be used for adding role |
role_id required | integer <int64> Role Id that will be used for adding role |
query Parameters
tenant_id | string <uuid> Tenant Id that will be used for adding role |
Responses
Response samples
- 200
- 400
- 401
- 403
- 404
- 409
- 500
{- "group_roles_id": "11",
- "tenant_id": "9d6d3054-a5f6-4dbf-86f9-26989eb73ed3",
- "group_id": "117",
- "role_id": 2,
- "created_by_user_id": "2",
- "modified_by_user_id": "2",
- "last_update_date": "2024-06-21T17:06:23.498Z",
- "from_date": "2024-06-21T17:06:23.498Z",
- "to_date": null
}
Delete an existing Group Role for a specific Tenant, Group and Role Id
Rules to delete a role of a group
- Cannot delete a Platform Admin Role for its own group.
- But can delete the Platform Admin Role of other Platform Admin groups.
Authorizations:
path Parameters
group_id required | integer <int64> Group Id that will be used for deleting role |
role_id required | integer <int64> Role Id that will be used for deleting role |
query Parameters
tenant_id | string <uuid> Tenant Id that will be used for deleting role |
Responses
Response samples
- 201
- 400
- 401
- 403
- 404
- 500
{- "message": "Deleted Group Role for the provided Tenant Id: '83d9056b-a3b3-4eb3-80db-1ed364428b0e', Group Id: 1, and Role Id: 1"
}
Get Resource details for a specific Resource Id
Resource details are filtered for a specific resource Id and returned in the form of JSON
Authorizations:
path Parameters
id required | integer <int64> Resource Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "resource_id": 0,
- "resource_path": "/api/v1/lookup_cloud_providers",
- "from_date": "2023-01-31T05:25:41.974Z",
- "to_date": null
}
]
Get all the Permission types
Permission types are returned in the form of JSON list
Authorizations:
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- [
- {
- "permission_id": 0,
- "permission": "GET",
- "description": "To list a resource",
- "from_date": "2024-06-14T08:40:52.540Z",
- "to_date": null
}
]
]
Get Permission type details for a specific Permission type Id
Permission type details are filtered for a specifc Permission type Id and returned in the form of JSON
Authorizations:
path Parameters
id required | integer <int64> Permission type Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "permission_id": 0,
- "permission": "GET",
- "description": "To list a resource",
- "from_date": "2024-06-14T08:40:52.540Z",
- "to_date": null
}
]
Response samples
- 200
- 400
- 401
- 404
- 500
[- [
- {
- "role_id": 0,
- "role": "User",
- "description": "GET (Lookup, Volume Config, Network Config, Boot Disk Image Config, Credentials Config, Object Storage Manager, Object Storage Manager Files, Hive Metastore Config, Cluster Configuration, Cluster Instance, Cluster Access Control, Workspace, Workspace Access Control, Spark Job Config, Spark Job Instance, Notebook Config, Notebook Instance, User) PUT (Spark Job Config, Workspace, Notebook Config) POST (Object Storage Manager Files, Workspace, Workspace Access Control, Spark Job Config, Spark Job Instance, Notebook Config, Notebook Instance) DELETE (Workspace Access Control)",
- "from_date": "2024-06-14T08:40:52.666Z",
- "to_date": null
}
]
]
Get Role details for a specific Role Id
Role details are filtered for a specific Role Id and returned in the form of JSON
Authorizations:
path Parameters
id required | integer <int64> Role Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "role_id": 0,
- "role": "User",
- "description": "GET (Lookup, Volume Config, Network Config, Boot Disk Image Config, Credentials Config, Object Storage Manager, Object Storage Manager Files, Hive Metastore Config, Cluster Configuration, Cluster Instance, Cluster Access Control, Workspace, Workspace Access Control, Spark Job Config, Spark Job Instance, Notebook Config, Notebook Instance, User) PUT (Spark Job Config, Workspace, Notebook Config) POST (Object Storage Manager Files, Workspace, Workspace Access Control, Spark Job Config, Spark Job Instance, Notebook Config, Notebook Instance) DELETE (Workspace Access Control)",
- "from_date": "2024-06-14T08:40:52.666Z",
- "to_date": null
}
]
Response samples
- 200
- 400
- 401
- 404
- 500
[- [
- {
- "rule_id": "754",
- "permission_type": {
- "permission_id": 0,
- "permission": "GET",
- "description": "To list a resource"
}, - "resource": {
- "resource_id": 194,
- "resource_path": "/api/v1/workspace/stats"
}, - "role": {
- "role_id": 3,
- "role": "Platform Admin",
- "description": "Can access and add or remove tenants across all tenants"
}, - "from_date": "2024-06-14T08:40:52.728Z",
- "to_date": null
}
]
]
Get Rule details for a specific Rule Id
Rule details are filtered for a specific Rule Id and returned in the form of JSON
Authorizations:
path Parameters
id required | integer <int64> Rule Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "rule_id": "754",
- "permission_type": {
- "permission_id": 0,
- "permission": "GET",
- "description": "To list a resource"
}, - "resource": {
- "resource_id": 194,
- "resource_path": "/api/v1/workspace/stats"
}, - "role": {
- "role_id": 3,
- "role": "Platform Admin",
- "description": "Can access and add or remove tenants across all tenants"
}, - "from_date": "2024-06-14T08:40:52.728Z",
- "to_date": null
}
]
Get all the Workspace Access Control Permissions
Workspace Access Control Permissions are returned in the form of JSON list
Authorizations:
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- [
- {
- "permission_id": 0,
- "name": "VIEW",
- "description": "To list the jobs inside the workspace",
- "from_date": "2024-06-14T08:40:53.788Z",
- "to_date": null
}
]
]
Get a Workspace Access Control Permission by Permission Id
Workspace Access Control Permission are returned in the form of JSON
Authorizations:
path Parameters
permission_id required | integer <int64> Permission Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "permission_id": 0,
- "name": "VIEW",
- "description": "To list the jobs inside the workspace",
- "from_date": "2024-06-14T08:40:53.788Z",
- "to_date": null
}
]
Get all the Rules for a specific Permission type Id
Rule details are filtered for a specific permission type Id and returned in the form of JSON list
Authorizations:
path Parameters
auth_permissions_type_id required | integer <int64> Permission type Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- [
- {
- "rule_id": "754",
- "permission_type": {
- "permission_id": 0,
- "permission": "GET",
- "description": "To list a resource"
}, - "resource": {
- "resource_id": 194,
- "resource_path": "/api/v1/workspace/stats"
}, - "role": {
- "role_id": 3,
- "role": "Platform Admin",
- "description": "Can access and add or remove tenants across all tenants"
}, - "from_date": "2024-06-14T08:40:52.728Z",
- "to_date": null
}
]
]
Get Rule details for a specific Rule Id and Permission type Id
Rule details are filtered for a specific Rule Id along with Permission type Id and returned in the form of JSON
Authorizations:
path Parameters
id required | integer <int64> Rule Id that will be used for filter |
auth_permissions_type_id required | integer <int64> Permission type Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "rule_id": "754",
- "permission_type": {
- "permission_id": 0,
- "permission": "GET",
- "description": "To list a resource"
}, - "resource": {
- "resource_id": 194,
- "resource_path": "/api/v1/workspace/stats"
}, - "role": {
- "role_id": 3,
- "role": "Platform Admin",
- "description": "Can access and add or remove tenants across all tenants"
}, - "from_date": "2024-06-14T08:40:52.728Z",
- "to_date": null
}
]
Get all the Rules for a specific Resource Id
Rule details are filtered for a specific Resource Id and returned in the form of JSON list
Authorizations:
path Parameters
auth_resources_id required | integer <int64> Resource Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- [
- {
- "rule_id": "754",
- "permission_type": {
- "permission_id": 0,
- "permission": "GET",
- "description": "To list a resource"
}, - "resource": {
- "resource_id": 194,
- "resource_path": "/api/v1/workspace/stats"
}, - "role": {
- "role_id": 3,
- "role": "Platform Admin",
- "description": "Can access and add or remove tenants across all tenants"
}, - "from_date": "2024-06-14T08:40:52.728Z",
- "to_date": null
}
]
]
Get Rule details for a specific Resource Id and Rule Id
Rules details are filtered for a specific Resources Id along with Rule Id and returned in the form of JSON
Authorizations:
path Parameters
id required | integer <int64> Rule Id will be used for filter |
auth_resources_id required | integer <int64> Resource Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "rule_id": "754",
- "permission_type": {
- "permission_id": 0,
- "permission": "GET",
- "description": "To list a resource"
}, - "resource": {
- "resource_id": 194,
- "resource_path": "/api/v1/workspace/stats"
}, - "role": {
- "role_id": 3,
- "role": "Platform Admin",
- "description": "Can access and add or remove tenants across all tenants"
}, - "from_date": "2024-06-14T08:40:52.728Z",
- "to_date": null
}
]
Get all the Rules for a specific Permission type Id and Resource Id
Rule details are filtered for a specific Permission type Id along with Resource Id and returned in the form of JSON list
Authorizations:
path Parameters
auth_resources_id required | integer <int64> Resource Id that will be used for filter |
auth_permissions_type_id required | integer <int64> Permission type Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- [
- {
- "rule_id": "754",
- "permission_type": {
- "permission_id": 0,
- "permission": "GET",
- "description": "To list a resource"
}, - "resource": {
- "resource_id": 194,
- "resource_path": "/api/v1/workspace/stats"
}, - "role": {
- "role_id": 3,
- "role": "Platform Admin",
- "description": "Can access and add or remove tenants across all tenants"
}, - "from_date": "2024-06-14T08:40:52.728Z",
- "to_date": null
}
]
]
Get Rule details for a specific Rule Id, Permission type Id, and Resource Id
Rule details are filtered for a specific Rule Id, Permission type Id and Resource Id is returned in the form of JSON
Authorizations:
path Parameters
id required | integer <int64> Rule Id that will be used for filter |
auth_resources_id required | integer <int64> Resource Id that will be used for filter |
auth_permissions_type_id required | integer <int64> Permission type Id that will be used for filter |
Responses
Response samples
- 200
- 400
- 401
- 404
- 500
[- {
- "rule_id": "754",
- "permission_type": {
- "permission_id": 0,
- "permission": "GET",
- "description": "To list a resource"
}, - "resource": {
- "resource_id": 194,
- "resource_path": "/api/v1/workspace/stats"
}, - "role": {
- "role_id": 3,
- "role": "Platform Admin",
- "description": "Can access and add or remove tenants across all tenants"
}, - "from_date": "2024-06-14T08:40:52.728Z",
- "to_date": null
}
]