The Dark Matter Environment

Dark Matter leverages several common third party Python libraries used for Data Science tasks.

Requirements.txt

boto3==1.34.99
Cython==3.0.10
numpy==1.26.4
pandas==2.2.2
torch==2.3.0
scikit-learn==1.5.0
matplotlib==3.9.0
ray[air,train]==2.37.0

Numpy, Pandas, PyTorch, SciKit-Learn, and Matplotlib are used to handle input data, train the Dark Matter algorithm, and track the algorithm's training cycle and metrics. We also use Boto3, Cython, and Ray for development operations like compiling and uploading source code to our S3 buckets, and parallelizing training across custom distributed compute environments.