ndementev

5 ms·

1. 1.▲
   OpenDataDiscovery 0.15 with Data Deprecation and Metadata Stale(github.com)

   7 points by ndementev 3y ago|0 comments
2. 2.▲
   by ndementev 4y ago

   Well, one of the differences is that we only require PostgreSQL as a external dependency in contrast with DataHub (MySQL, Kafka, ElasticSearch). Please correct me if I wrong about this list of DataHub's external dependencies.
3. 3.▲
   by ndementev 4y ago

   Gotcha! We are continue working on a documentation, thank you for bringing this up! We'll take a look how this can be improved. > For example: all the steps under 3. are not part of ODD, or are they? Only step 1 is performed in ODD,
4. 4.▲
   by ndementev 4y ago

   Thank you! Actually everything is working on a push basis in ODD now. ODD Platform implements ODD Specification ( https://github.com/opendatadiscovery/opendatadiscovery-speci... ) and all agents, custom scripts and integ
5. 5.▲
   by ndementev 4y ago

   While Pachyderm (a great product by the way) helps teams to automate transformation tasks, ODD is more of a discovery/observability/monitoring solution for your pipelines. Basically if Pachyderm helps you to build a pipeline, ODD
6. 6.▲
   by ndementev 4y ago

   Thank you for your kind words! May I ask you what do you mean by saying "all steps under 3"? Are you referring to https://docs.opendatadiscovery.org/use_cases/dq_visibility ? As for the > How is the lineage
7. 7.▲
   by ndementev 4y ago

   Thank you! We have a lot of repositories on GitHub, please feel free to pick any issue from the list. Do not hesitate to ask us anything in GitHub issues' threads or in our Slack community. I'll provide links for your convinience
8. 8.▲
   by ndementev 4y ago

   Thank you for your kind words and a constructive feedback! We appreciate it. Let me cover some of your reactions from my perspective as a Data Engineer. Please feel free to add your opinion on those > Shorten data discovery phase. In my
9. 9.▲
   by ndementev 4y ago

   Gotcha! Thank you for the input, we are going to work on this.
10. 10.▲
    by ndementev 4y ago

    Well, for setting the platform's features up there's this page: https://docs.opendatadiscovery.org/configuration-and-deploym... It explains how to set up a platform in a way that certain features were enabled&#x2F
11. 11.▲
    by ndementev 4y ago

    I see your point. As you mentioned the product is rather young and we continue to develop it. I agree that documentation is one of the fundamental parts. Thank you for your input, we will find a way to make the documentation more straight f
12. 12.▲
    Show HN: Open source data discovery and observability platform(opendatadiscovery.org)

    122 points by ndementev 4y ago|36 comments