Follow BigDATAwire:

Tag: Ray

The Spark-to-Ray Migration That Will Save Amazon $100M+ Per Year

When Ray first emerged from the UC Berkeley RISELab back in 2017, it was positioned as a possible replacement for Apache Spark. But as Anyscale, the commercial outfit behind Ray, scaled up its own operations, the “Ray Read more…

Why Samsara Picked Ray to Train AI Dashcams

When the engineers at Samsara began building their first smart dashcam several years ago, they found themselves using a series of different frameworks to collect data from the IoT devices, train the machine learning mode Read more…

Anyscale and Nvidia In LLM Hookup

GenAI developers building atop large language models (LLMs) are the big winners of a new partnership between Anyscale and Nvidia unveiled this week that will see the GPU maker’s AI software integrated into Anyscale’s Read more…

Anyscale Takes On LLM Challenges with Aviary

Anyscale has announced a new open source project called Aviary focused on developing applications with open source large language models. With all the new open source LLMs to choose from, it may be difficult to decide Read more…

HPE Brings Analytics Together on its Data Fabric

HPE today unveiled a major update to its Ezmeral software platform, which previously included over a dozen components but now includes just two, including the Ezmeral Data Fabric that provides edge-to-cloud data manageme Read more…

AnyScale Bolsters Ray, the Super-Scalable Framework Used to Train ChatGPT

ChatGPT developer OpenAI is using Ray, an open-source unified compute framework, to ease the infrastructure costs and complexity of training its large language models. Anyscale, the company behind Ray, has made enhanceme Read more…

AWS Bolsters Glue ETL Tool with Data Observability, Ray Support

AWS has made a big push into data management during re:Invent this week, with the unveiling of DataZone and launch of zero-ETL capabilities in Redshift. But AWS also bolstered its ETL tool with the launch of Amazon Glue Read more…

Anyscale Branches Beyond ML Training with Ray 2.0 and AI Runtime

Anyscale today came one step closer to fulfilling its goal of enabling any Python application to scale to an arbitrarily large degree with the launch of Ray 2.0 and the Ray AI Runtime (Ray AIR). The company also announce Read more…

Anyscale Nabs $100M, Unleashes Parallel, Serverless Computing in the Cloud

With a fresh $100 million in the bank and $1 billion valuation, UC Berkeley’s RISELab alum Anyscale is now set to scale up its business as the latest data unicorn. The company also announced the general availability of Read more…

From Amazon to Uber, Companies Are Adopting Ray

What if you could use your favorite machine learning library to code an AI program on your laptop, and have it automatically transferred to run in a massive, distributed fashion on the cloud? That’s the general idea be Read more…

Scaling to Great Heights at the Ray Summit

If you haven’t yet heard about Ray, the open source Python framework for building distributed applications, then next week’s Ray Summit will provide a compelling introduction to what might be one of the cornerstone t Read more…

The Future of Computing is Distributed

Distributed applications are not new. The first distributed applications were developed over 50 years ago with the arrival of computer networks, such as ARPANET. Since then, developers have leveraged distributed systems Read more…

Anyscale Emerges from Stealth with Plan to Scale Ray

Anyscale emerged from stealth today with a Series A round of venture capital worth $20.6 million from Andreessen Horowitz and the rough outlines of a plan to scale Ray, the RISELab technology that effectively turns every Read more…

Why Every Python Developer Will Love Ray

There are many reasons why Python has emerged as the number one language for data science. It's easy to get started and relatively forgiving for beginners, yet it's also powerful and extensible enough for experts to take Read more…

Ray’s New Library Targets High Speed Reinforcement Learning

Data scientists looking to push the ball forward in the field of reinforcement learning may want to check out RLlib, a new library released as open source last month by researchers affiliated with RISELab. According to r Read more…

Meet Ray, the Real-Time Machine-Learning Replacement for Spark

Researchers at UC Berkeley's RISELab have developed a new distributed framework designed to enable Python-based machine learning and deep learning workloads to execute in real-time with MPI-like power and granularity. Ca Read more…

BigDATAwire