NEW on We
Open Source
Daniel Paes introduces Runink: a Go-native, open source platform that makes data pipelines fast, secure, and Kubernetes-free. Built with Linux primitives and Raft for strong governance.
https://allthingsopen.org/articles/runink-rethinking-data-pipelines-go-raft-linux-primitives
Handling data in Kubernetes - the cloud native way with Jonathan Gonzalez V.
From zero to a production-ready PostgreSQL cluster using CloudNativePG. Real DevOps for your data layer in action.
#DevOpsDaysAMS #Kubernetes #PostgreSQL #CloudNative #DevOps #DataOps
Data diff isn’t enough.
You’re putting out harmless fires while real metric failures burn unnoticed.
You don’t need more diffing. You need better understanding.
Read https://datarecce.io/blog/more-than-data-diff/
Join us on Wednesday, June 4 to talk about: Model Context Protocol
Vivek Mangipudi will lead the discussion in our #DataOps meeting.
Want to join? Reply and we'll add you.
Tired of babysitting DIY scraping scripts that crash the moment you scale?
You’re not alone.
PromptCloud takes the pain out of large-scale data extraction with fully managed, reliable solutions — so you can focus on what really matters: insights.
The MLOps skillset is evolving!
Reddit shows a clear trend: DataOps is emerging as a distinct specialization, separate from traditional DevOps.
Is your organization prepared for this shift?
Full blog post: https://dougortiz.blogspot.com/2025/05/the-quiet-revolution-in-mlops-dataops.html
What training programs are you implementing to address this emerging DataOps talent gap?
𝐇𝐚𝐫𝐝𝐜𝐨𝐝𝐢𝐧𝐠 𝐢𝐬 𝐇𝐮𝐫𝐭𝐢𝐧𝐠 𝐘𝐨𝐮𝐫 𝐓𝐞𝐚𝐦
Still hardcoding values in your data pipelines? It’s slowing down scaling.
It creates more bugs.
It’s not enterprise-ready.
Learn how to parameterize Azure Data Factory like a pro - with real-world strategies you can apply immediately after training.
Save your team hours of rework.
Build once, reuse forever.
Live 6/11 - just $249.
1st 20 registrants get the bonuses!
Get your seat: https://entdna.com/product/advanced-azure-data-factory-adf-course-jun-2025/
Picked up "Python Polars the definitive guide" by Jeroen Janssens and Thijs Nieuwdorp. The polar bear was already used on another O'Reilly book, but the Iberian lynx is cool.
Never sure how tech books will pan out, but Jeroen's book data science at the command line was a good one, so I am hopeful.
What breaks if I change this column?
Read our technical deep-dive into how Recce constructs column-level lineage from #dbt models
- How we track column origins and transformations using SQLGlot
- How we classify columns as pass-through, renamed, derived, or source
- How we handle tricky edge cases like SELECT *, name collisions, and macro expansion
Read more:
https://datarecce.io/blog/column-level-lineage-internals/
Stop duplicating dashboards to preview the impact of dbt model changes!
With Recce, you can: Diff models
Record data impact
Share results instantly — no dashboards, no SQL, no screenshots
One click. Instant clarity:
Big move: Fivetran + Census unite for seamless data flow. No more custom code headaches. Just pure data harmony.
#DataOps #ETL #DevTools https://www.fivetran.com/blog/why-fivetran-and-census-are-joining-forces
Need clear “done” definitions when balancing code & data?
Align engineering & analytics acceptance criteria to avoid moving goalposts.
We believe data should be clean, actionable — and sometimes a little fun.
This table has a hidden message woven into the product titles. Can you find it?
Always wanted to learn the Fundamentals of #DataOps? Watch this workshop: https://youtu.be/hZ8NpMgPKcM
𝗧𝗵𝗲 𝗵𝗶𝗱𝗱𝗲𝗻 𝗰𝗼𝘀𝘁 𝗼𝗳 𝗰𝘂𝘁𝘁𝗶𝗻𝗴 𝗰𝗼𝗿𝗻𝗲𝗿𝘀? 𝗧𝗲𝗰𝗵𝗻𝗶𝗰𝗮𝗹 𝗱𝗲𝗯𝘁, not just another corporate buzzword but the silent killer of efficiency, innovation, and organizational success.
Understand what technical debt means in a datamanagement context.
https://www.datalumen.eu/technicaldebt_datamanagement/
#DataGovernance #DataManagement hashtag#DataArchitecture #DataOps #DataOpsFramework #DevOps #DataStrategy #DataAgenda
Latest #ContinuousSpotlight is on
Lisa N. Cao. You might know her as a CDF Ambassador or the person who launched our #DataOps Initiative, but she's so much more. Get to know her: https://cd.foundation/blog/2025/03/24/continuous-spotlight-meet-lisa-n-cao/
Join our next #ContinuousDelivery Workshop on March 27
The Fundamentals of #DataOps with speaker Lisa N. Cao
It's virtual and free: https://cd.foundation/blog/2025/03/13/workshop-dataops/
Help us develop an inclusive set of #DataOps and #DevOps best practices to allow others leverage open source tools and frameworks for streamlined, secure, and scalable ML application deployment. https://cd.foundation/blog/2025/01/23/announcing-dataops-initiative/