Must-Have SQL Skills for Aspiring Data Engineers
Mastering SQL is non-negotiable! Learn how to:
Write complex JOINs
Optimize queries for performance
Use window functions
Handle large datasets
Write clean, maintainable code
SQL is the backbone of data pipelines—start strong!
#DataEngineering #SQL #TechCareers #BrowseJobs #DataSkills

A great job with a fantastic group: https://www.dataorchard.org.uk/analytics-engineer-vacancy

#DataScience #DataEngineering #RStats #JobFairy #FediHire @data_orchard

Ist ja nicht so sehr business network hier aber vielleicht ist heute zufällig noch jemand auf der TechShow Frankfurt unterwegs bzw Big Data & AI World?

Aus der @OSBA ?

I'm on my way to the Applied AI, Data & Analytics Meetup in Zürich. Looking forward to seeing the talks by @ssp.sh, @mehdio.com and others and learn about the latest trends in #DataEngineering and #DataAnalytics www.meetup.com/de-DE/applie...

Applied AI, Data & Analytics m...

In this article, Vitalii Honchar explained how to build AI-powered apps that can chat with uploaded PDF files. He showed how to implement Retrieval Augmented Generation (RAG) using FastAPI for the API and LangChain to interact with OpenAI.

https://vitaliihonchar.com/insights/python-rag-api

Data diff isn’t enough.
You’re putting out harmless fires while real metric failures burn unnoticed.

You don’t need more diffing. You need better understanding.
Read https://datarecce.io/blog/more-than-data-diff/

Master Microsoft Fabric – The Future of Data Analytics!
Boost your career with in-demand skills in Data Synapse + Microsoft Fabric. Get hands-on experience with real-time projects, led by expert trainers.

What You'll Learn:
Power BI
Data Factory
Data Engineering
Business Intelligence
Data Integration

Online Free Demo

For More Info: +91 7032290546
Visit Website: https://www.visualpath.in/online-microsoft-fabric-training.html
WhatsApp Chat: https://wa.me/c/917032290546

New Slides

I've made the slides for my recent talk on "Legal Data Engineering" available #OpenAccess

Slides: https://zenodo.org/records/15575231 (in German)

Web scraping needs vary widely, so should your approach.
Should you:

• Build your own custom scrapers?
• Use a plug-and-play scraping tool?
• Go fully managed with a web scraping service?

In this blog, we simplify the decision-making process with a no-fluff comparison of:
Cost
Control
Scalability
Maintenance

Read the full blog: https://bit.ly/3ZHWxL6

Slides zu Legal Data Engineering

Was ist Legal Data Engineering? Wie sieht die Praxis juristischer Daten in Deutschland aus? Welche rechtlichen Probleme ergeben sich im Zusammenhang mit Legal Data Engineering? Diese Präsentation bietet eine Einführung zu Legal Data Engineering und sucht Antworten auf diese Fragen.

Slides: https://zenodo.org/records/15575231/files/Fobbe_2025-05-28_Legal-Data-Engineering.pdf?download=1

Legal Data Engineering ist der Schwerpunkt eines jeden Legal Data Science Projekts. Kern von Data Engineering ist der ETL-Prozess: Extraktion, Transformation und das (Hoch-)Laden von Daten. Die Slides bieten dazu einen allgemeinverständlichen Überblick.

Weitere praktische Themen sind die Verfügbarkeit juristischer Daten in Deutschland (insbesondere strukturierter Daten und Programmierschnittstellen), Probleme bei der Tokenisierung in Large Language Models und die Fehlerkennung von Gen-Namen in Microsoft Excel.

Bei den rechtlichen Fragen des Legal Data Engineering behandle ich die tradierte Rechtslage, das neue Datennutzungsgesetz (DNG) und Bayern als Negativbeispiel einer verschlossenen juristischen Datenkultur. Eine Diskussion der Datenschutzklage gegen OpenJur und der Open Data-Klage der Gesellschaft für Freiheitsrechte (GFF) gegen die Bundespolizei klären über aktuelle Entwicklungen in diesem Rechtsbereich auf.

Hacking Data Engineering Webinar

Tips and resources on how to become a data engineer on your own #dataengineering #workshop #cheatsheet #career ... source

https://quadexcel.com/wp/hacking-data-engineering-webinar/

I compressed 10k PDFs into a 1.4GB video for LLM memory

https://github.com/Olow304/memvid

DBT BigQuery Data Engineering crash course #DataEngineering #DBT #BigQuery #SQL #CloudComputing #ETL

Dive into DBT & BigQuery in just 30 mins! Master modern data engineering essentials. Perfect for beginners & pros alike. source

https://quadexcel.com/wp/dbt-bigquery-data-engineering-crash-course-dataengineering-dbt-bigquery-sql-cloudcomputing-etl/

So I said I was gonna be posting Data Engineering stuff here and this is my first attempt at that, hehehe.

https://buildingblocks.hashnode.dev/getting-started-with-apache-nifipart-1

Want to break into Data Engineering or boost your portfolio? Check out these 5 practical project ideas covering ETL, real-time streaming, web scraping, cloud workflows & dashboards. Tools used include Airflow, Kafka, BigQuery, and Power BI. Build real-world skills that employers love! Checkout https://in.pinterest.com/pin/1073404892439053122/ #DataEngineering #Python #ETL #BigData #PortfolioProjects #TechCareers #MastodonTech

Tomorrow newsletter will be out. Interesting stuff by @realpython Arjan Egges @llamaindex Vaibhav Mehra, Altamash Ansari covered

https://newsletter.piptrends.com/p/namespaces-anti-patterns-llamadev

LangGraph is a powerful library for creating advanced conversational AI workflows. If you're interested in learning how to use it and want to build your own AI agent, check out the freeCodeCamp course by Vaibhav Mehra. It's a great starting point to explore LangGraph in action.

https://www.youtube.com/watch?v=jGg_1h0qzaM

I'm the kind of person who gets excited about new filesystem based dbs. I'm also the kind of person who likes ducks.

Today is a good day so far: https://duckdb.org/2025/05/27/ducklake.html

The @llamaindex ecosystem has over 650 Python packages in a monorepo, making dependency management and publishing a challenge. To solve this, the team built LlamaDev and used uv it for improved performance. In this post, Massimiliano Pippi explains the issues they faced, what they tried and why they ultimately created LlamaDev.

https://www.llamaindex.ai/blog/python-tooling-at-scale-llamaindex-s-monorepo-overhaul