Expansion of Instance Types

Currently, only types using NVIDIA T4 can be selected as GPU instances.
However, the T4 is somewhat outdated, lacking support for bfloat16 and having only 16GB of VRAM, which is becoming insufficient for running the latest small-scale LLMs and other applications.

Therefore, I hope that support for A10G and L4 instances, such as G5 and G6, will be considered.

1 Like

Thank you for supporting the A10G instance type!! :smile:

2 Likes

You’re welcome! :slight_smile:

Happy Dataloring!