Master

The tuning master.

lorien.tune.master.get_manager_configs(configs: argparse.Namespace) Tuple[Optional[Type[lorien.tune.job_manager.JobManagerBase]], Optional[Any]]

Validate the job manager configurations and fetch them.

Parameters

configs (argparse.Namespace) -- The system configurations.

Returns

manager_cls, data -- The job manager class and configuration.

Return type

Tuple[Optional[Type[JobManagerBase]], Optional[Any]]

lorien.tune.master.get_target(configs: argparse.Namespace) Optional[str]

Parse worker info and get the target for creating table and S3 buckets.

Parameters

configs (argparse.Namespace) -- The system configurations.

Returns

target -- The target string, or None if the required configuration is missing.

Return type

Optional[str]

lorien.tune.master.parse_manager_info(target: str, configs: argparse.Namespace, jobs: List[lorien.tune.job.Job]) Tuple[Type[lorien.tune.job_manager.JobManagerBase], Dict[str, Any]]

Parse and formulate worker info.

Parameters
  • target (str) -- The target string.

  • configs (argparse.Namespace) -- The system configurations.

  • jobs (List[Job]) -- A complete list of jobs to be tuned.

Returns

worker_info -- A list of (manager class, manager info).

Return type

List[Tuple[Type[JobManagerBase], Dict[str, Any]]]

lorien.tune.master.run(configs: argparse.Namespace)

Distribute workloads to job managers and track the progress.

Parameters

configs (argparse.Namespace) -- The system configuration of tuner.

lorien.tune.master.run_job_manager(manager_cls: Type[lorien.tune.job_manager.JobManagerBase], packed_args: Dict[str, Any]) List[lorien.tune.result.TuneResult]

Tune workloads on a worker.

Parameters
  • manager_cls (Type[JobManagerBase]) -- The job manager class definition.

  • packed_args (Dict[str, Any]) -- The packed job manager arguments.

Returns

results -- The result can be either the performance or error message.

Return type

List[TuneResult]