Krishiv

Spark-compatible compute. Written in Rust.

In development

Your data platform, on an engine that already speaks Spark.

Workspaces, catalog, pipelines and notebooks, running your existing Spark code.

Request early access

What it brings

  • Workspaces

    SQL editor and notebooks for teams, on shared data.

  • Catalog and governance

    One place for tables, with access control.

  • Pipelines and jobs

    Batch and streaming pipelines, scheduled and monitored.

  • Managed compute

    Compute that sizes itself, with no tuning knobs.

  • Security

    Single sign-on, roles and an audit trail.

  • Usage visibility

    See what every team and job uses.

Built on the Krishiv engine

  • Bring your Spark code

    Existing PySpark over Spark Connect (in progress). Krishiv is compatible with Apache Spark™.

  • Batch, streaming and incremental views

    One engine for all three (streaming and incremental views are in progress).

  • Laptop to cluster

    The same engine embedded in your process today; server and distributed modes are in progress.

  • Open source

    The engine is open source under Apache 2.0. Explore Krishiv Engine.

Who it is for

  • Data engineering teams

    Running Spark today and wanting a faster, simpler engine under the same code.

  • Platform teams

    Building an internal data platform and wanting a foundation to build it on.

  • Analytics and ML teams

    Wanting one engine for batch and streaming work.

Questions

When will it be available?

We will share timelines with early-access members first.

Can I use the engine today?

Yes: Krishiv Engine 0.2.

Will my Spark code work?

Krishiv is compatible with Apache Spark™; see the compatibility page.

Cloud or self-hosted?

Deployment options, cloud and self-hosted, will be shared with early-access members first.

Be the first to try it

One email when early access opens. Nothing else.

Questions? info@krishiv.ai

Available today: Krishiv Engine 0.2, the open-source compute engine the platform is built on. Explore the engine

  • Operator

    Krishiv AI. Contact: info@krishiv.ai. Krishiv Engine is open source under Apache-2.0.

  • Trademarks

    Apache Spark and Spark are trademarks of the Apache Software Foundation. Krishiv is not Apache Spark and is not endorsed by or affiliated with the Apache Software Foundation.