Guild
Guilds
Events
Presentations
Guilds
Events
Presentations
Sign In
Sign Up
Dark Mode
English
Primary Photo for {0} {1}

KayodeA Adeniyi

User
Presentations
Events
Guilds
User
Presentations
Events
Guilds
Upcoming Presentations
Cover Photo for The Dependency Graph Your Tests Can't See

The Dependency Graph Your Tests Can't See

A model I was working with scored R squared 0.998 on public US data. One of the input columns had been calculated from the target by the same agency that published both, so the model was rediscovering a formula it had already been handed. Tests don't catch this. Nothing throws, nothing fails, the numbers look great. So I built a linter for it. You write a manifest of what derives from what, the tool walks the graph, and CI goes red when a feature sits on a derivation path to or from your target. It returns four verdicts, including one for columns whose provenance nobody has traced yet. The code is Python. The idea applies anywhere you have a dependency graph and a CI job. I'll show the leak, the manifest, the linter, and a run going red live.
Repo: https://github.com/Adeniyikayodee/derives-from-tutorial

Primary Photo for {0} {1}KayodeA Adeniyi
Primary Photo for {0} {1}

KayodeA Adeniyi

User
Presentations
Events
Guilds
User
Presentations
Events
Guilds
Upcoming Presentations
Cover Photo for The Dependency Graph Your Tests Can't See

The Dependency Graph Your Tests Can't See

A model I was working with scored R squared 0.998 on public US data. One of the input columns had been calculated from the target by the same agency that published both, so the model was rediscovering a formula it had already been handed. Tests don't catch this. Nothing throws, nothing fails, the numbers look great. So I built a linter for it. You write a manifest of what derives from what, the tool walks the graph, and CI goes red when a feature sits on a derivation path to or from your target. It returns four verdicts, including one for columns whose provenance nobody has traced yet. The code is Python. The idea applies anywhere you have a dependency graph and a CI job. I'll show the leak, the manifest, the linter, and a run going red live.
Repo: https://github.com/Adeniyikayodee/derives-from-tutorial

Primary Photo for {0} {1}KayodeA Adeniyi

Guild

DocsTermsPrivacy

Get in touch!

hi@guild.host