logo-icon
blog-shape
7 min read

Querying 40,000+ datasets with SQL

Learn about how Splitgraph indexes over 40,000 datasets from government and public sources using the Socrata API, Splitgraph mounting, and PostgreSQL foreign data wrappers.

featured-img
Jul 8, 2020 · By Artjoms Iškovs
7 min read

Splitgraph infrastructure, part 2: Integration testing with Docker Compose

Jul 8, 2020 · By Artjoms Iškovs

We continue our overview of Splitgraph's internal build infrastructure by talking about how we run end-to-end integration tests. We also discuss using Jinja to generate configuration and inject secrets into our components.

Jul 6, 2020 · By Artjoms Iškovs
8 min read

Splitgraph infrastructure, part 1: Using Make to build multiple Docker images efficiently

Jul 6, 2020 · By Artjoms Iškovs

We begin our overview of Splitgraph's internal build infrastructure by discussing how we build Docker images in development and CI using Make and Docker BuildKit.

Jul 2, 2020 · By Artjoms Iškovs
9 min read

Foreign data wrappers: PostgreSQL's secret weapon?

Jul 2, 2020 · By Artjoms Iškovs

We talk about foreign data wrappers, a PostgreSQL feature that lets you query remote databases directly from your PostgreSQL instance. We also demonstrate how to integrate them with Splitgraph.

Jun 30, 2020 · By Artjoms Iškovs
5 min read

Treat your datasets like cattle, not pets

Jun 30, 2020 · By Artjoms Iškovs

We talk about the "pets versus cattle" idea in software and discuss how Splitgraph helps to apply it to data science and data engineering.

Jun 26, 2020 · By Artjoms Iškovs
6 min read

It took 10 minutes to add support for DataGrip to Splitgraph

Jun 26, 2020 · By Artjoms Iškovs

We discuss a philosophy of not breaking existing abstractions that we think explains the success of tools like Docker and Git and how we applied it to Splitgraph, helping us launch with multiple integrations.

Jun 24, 2020 · By Miles Richardson, Artjoms Iškovs
6 min read

Welcome to Splitgraph

Jun 24, 2020 · By Miles Richardson, Artjoms Iškovs

Announcing Splitgraph, a data versioning and management system that allows you to work with data like you work with code.

 
2 / 2