S3 to GPU at 60Gbps: Why Parquet is Bottlenecking Your Data

InfoQ · 49:38

Vortex, an open-source columnar file format (Linux Foundation), lets a GPU scan pull data from S3 at tens of Gbit/s with minimal copies and little CPU. Its layouts and cascaded encodings prune data and compute on comp...

Read the full summary on tuber

Redirecting...