awesome-spark
github.com/awesome-spark/awesome-spark ↗A curated list of awesome Apache Spark packages and resources.
Use this list with your AI agent
Add the Context Awesome MCP server to Claude, Cursor, or any MCP client, then ask:
"Show me bioinformatics resources from awesome-spark"
Installation instructions →What's inside
Packages
- ADAMBioinformatics
Set of tools designed to analyse genomics data.
- almondNotebooks and IDEs
A scala kernel for
- Apache BahirStreaming
Collection of the streaming connectors excluded from Spark 2.0 (Akka, MQTT, Twitter. ZeroMQ).
- Apache BeamInterfaces
Unified data processing engine supporting both batch and streaming applications. Apache Spark is one of the supported execution environments.
- Apache DataFuGeneral Purpose Libraries
A library of general purpose functions and UDF's.
- Apache HudiStorage
Upserts, Deletes And Incremental Processing on Big Data..
Resources
- Advanced Analytics with SparkBooks
Useful collection of Spark processing patterns. Accompanying GitHub repository:
- AMP CampWorkshops
Periodical training event organized by the
- apache/sparkDocker Images
Apache Spark Official Docker images.
- Apache Spark User ListMiscellaneous
Mailing lists dedicated to usage questions and development topics respectively.
- Big Data Analysis with Scala and Spark (Coursera)MOOCS
Scala oriented introductory course. Part of
- CrossdataProjects Using Spark
Data integration platform with extended DataSource API and multi-user environment.
Showing a sample of 78 resources. View the full list on GitHub →