logo

latest

  • What is MARO?

Installation

  • Package
  • Playground Docker Image
  • Grass Cluster Provisioning on Azure
  • Grass Cluster Provisioning in On-Premises Environment
  • K8S Cluster Provisioning on Azure
  • Multi-processes Localhost Provisioning

Scenarios

  • Container Inventory Management (CIM)
  • Bike Repositioning (Citi Bike)
  • Virtual Machine Scheduling (VM Scheduling)
  • Command support for scenarios

Examples

  • Multi Agent DQN for CIM
  • Greedy Policy for Citi Bike

Key Components

  • Simulation Toolkit
  • Data Model
  • Event Buffer
  • Business Engine
  • RL Toolkit
  • Distributed Toolkit
  • Distributed Communication
  • Distributed Orchestration
  • Dashboard Visualization
  • Geographic Visualization

API Documents

  • Simulation Toolkit
    • Data Model
    • Event Buffer
    • Business Engine
    • Utils
  • RL Toolkit
  • Utils
Theme by the Executable Book Project
Contents

Simulation Toolkit¶

  • Data Model
    • maro.backends.frame
  • Event Buffer
    • maro.event_buffer.event_buffer
  • Business Engine
    • maro.simulator.scenarios.abs_business_engine
  • Utils
    • maro.simulator.utils.common
    • maro.simulator.utils.event_bind_binreader
    • maro.simulator.utils.sim_random

RL Toolkit¶

  • Agent
    • maro.rl.agent.abs_agent
    • maro.rl.agent.dqn
    • maro.rl.agent.ddpg
    • maro.rl.agent.policy_optimization
  • Agent Manager
    • maro.rl.agent.abs_agent_manager
  • Model
    • maro.rl.model.learning_model
  • Explorer
    • maro.rl.exploration.abs_explorer
    • maro.rl.exploration.epsilon_greedy_explorer
    • maro.rl.exploration.noise_explorer
  • Scheduler
    • maro.rl.scheduling.scheduler
    • maro.rl.scheduling.simple_parameter_scheduler
  • Shaping
    • maro.rl.shaping.abs_shaper
  • Storage
    • maro.rl.storage.abs_store
    • maro.rl.storage.simple_store
  • Actor
    • maro.rl.actor.abs_actor
    • maro.rl.actor.simple_actor
  • Learner
    • maro.rl.learner.abs_learner
    • maro.rl.learner.simple_learner
  • Distributed Topologies
    • maro.rl.dist_topologies.common
    • maro.rl.dist_topologies.single_learner_multi_actor_sync_mode

Utils¶

  • Logger
    • maro.utils.logger
  • Exceptions
    • maro.utils.exception.backends_exception
    • maro.utils.exception.base_exception
    • maro.utils.exception.cli_exception
    • maro.utils.exception.communication_exception
    • maro.utils.exception.data_lib_exeption
    • maro.utils.exception.error_code
    • maro.utils.exception.rl_toolkit_exception
    • maro.utils.exception.simulator_exception
  • Communication
    • maro.communication.driver.abs_driver
    • maro.communication.driver.driver_type
    • maro.communication.driver.zmq_driver
    • maro.communication.dist_decorator
    • maro.communication.message
    • maro.communication.proxy
    • maro.communication.registry_table
  • Others
    • maro.utils.utils
Geographic Visualization Data Model

By MARO Team
© Copyright 2020 Microsoft.