data-discovery

There are 23 repositories under data-discovery topic.

• applied-ml

  eugeneyan / applied-ml

  📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.

  applied-machine-learningproductionapplied-data-sciencemachine-learningdata-sciencereinforcement-learningdata-engineeringrecsyssearchdeep-learningdata-qualitydata-discoverycomputer-visionnatural-language-processing
  26065
• datahub

  datahub-project / datahub

  The Metadata Platform for your Data Stack

  metadatalinkedindatahubdata-catalogdata-discoveryhacktoberfest
  Language:Java 9273

• amundsen-io / amundsen

  Amundsen is a metadata driven application for improving the productivity of data analysts, data scientists and engineers when interacting with data.

  amundsenmetadatadata-catalogdata-discoverylinuxfoundation
  Language:Python 4295
• OpenMetadata

  open-metadata / OpenMetadata

  Open Standard for Metadata. A Single place to Discover, Collaborate and Get your data right.

  data-catalogdata-collaborationdata-contractsdata-discoverydata-governancedata-lineagedata-observabilitydata-profilingdata-qualitydata-quality-checksdata-sciencedata-validationdatacatalogdatadiscoverydataengineeringdataqualitydbtmetadatametadata-managementsnowflake
  Language:TypeScript 4276

• MarquezProject / marquez

  Collect, aggregate, and visualize a data ecosystem's metadata

  data-lineagedata-discoverydata-governancedata-provenancemetadata-servicedata-dictionarymarquezmetadatadata-ecosystem-metadatadata-ops
  Language:Java 1637

• reata / sqllineage

  SQL Lineage Analysis Tool powered by Python

  data-discoverydata-lineagelineagemetadatasqldata-governance
  Language:Python 1148
• odd-platform

  opendatadiscovery / odd-platform

  First open-source data discovery and observability platform. We make a life for data practitioners easy so you can focus on your business.

  ossdata-platformmetadatametadata-managementdata-pipelinesdata-engineeringobservabilitydata-catalogdatacatalogdata-discoverydata-lineagebigdataalertinglineagedata-profilingdata-explorationdata-governancedata-qualitydata-sciencedata-observability
  Language:Java 1125

• nasa / earthdata-search

  Earthdata Search is a web application developed by NASA EOSDIS to enable data discovery, search, comparison, visualization, and access across EOSDIS' Earth Science data holdings.

  data-discoveryearthdata-searcheosdishacktoberfest
  Language:JavaScript 731

• rsyi / whale

  🐳 The stupidly simple CLI workspace for your data warehouse.

  data-catalogdata-discoverydata-documentation
  Language:Python 724
• awesome-data-catalogs

  opendatadiscovery / awesome-data-catalogs

  📙 Awesome Data Catalogs and Observability Platforms.

  awesomeawesome-listbig-datadata-catalogdata-discoverydata-engineeringdata-qualitydatacatalogdatadiscoverydataopsmetadatametadata-managementmlobservabilityopen-sourceopendataopensourceoss
  597
• recap

  recap-build / recap

  Work with your web service, database, and streaming schemas in a single format.

  data-catalogmetadatadata-discoveryrecapdata-engineeringdata-integrationdata-pipelinesetl
  Language:Python 305

• SWHL / AI-Competition-Collections

  AI比赛经验帖子 & 训练和测试技巧帖子 集锦（收集整理各种人工智能比赛经验帖）

  cvnlpcompetitionrecommender-systemspeechdata-discoverygraph-neural-networksknowledge-graph
  Language:Python 267
• OPC-UA-OOI

  mpostol / OPC-UA-OOI

  Object Oriented Internet - C# deliverables supporting a new Machine To Machine (M2M) communication architecture

  iotiiotpublish-subscribenetworkingopc-uac-sharpinternetsemantic-datadata-discoverym2mebookmetadataooicommunicationopcuadata-oriented-architecture
  Language:C# 141
• opendatadiscovery-specification

  opendatadiscovery / opendatadiscovery-specification

  ODD Specification is a universal open standard for collecting metadata.

  apibig-databig-data-platformdata-discoverydata-engineeringdata-governancedata-meshdata-platformmetadatametadata-managementmetadata-parseropen-sourceopensourcespecspecification
  117

• getmetamapper / metamapper

  Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.

  metamapperdata-catalogdata-discoveryschema-inspectiondata-warehousepythondjangodata-curationmetadata
  Language:Python 76

• opendatadiscovery / odd-collector

  Open-source metadata collector based on ODD Specification

  data-catalogdata-discoverydata-governancedata-observabilitydata-piplinesdata-platformdata-profilingdatacataloghacktoberfestlineage
  Language:Python 42

• commondataio / dataportals-registry

  Registry of data portals, catalogs, data repositories including data catalogs dataset and catalog description standard

  data-catalogdata-portaldata-repositorydatasetsregistrydata-discoveryopendatadatasetopen-data
  Language:Python 29

• biocaddie / WG3-MetadataSpecifications

  WG3 Metadata Specification

  data-discoverydats-modeldata-modelingjson-schemasjson-ldschema-org
  Language:Python 26
• stairlight

  tosh2230 / stairlight

  A data lineage tool detects table dependencies from rendered SQL statements.

  sqldata-lineageredashdbtbigquerydata-engineeringgcss3data-catalogdata-governancedata-opsdata-discoverydata-managementlineage
  Language:Python 26

• carte-data / carte

  A Python library to generate static data catalog sites. Carte scrapes metadata from your data assets and generates a fully searchable front end that's just HTML.

  data-catalogdata-discoverydata-documentationcartelightweight-data-catalogspython-library
  Language:Python 25

• tsegall / fta

  Metadata/data identification Java library. Identifies Semantic Type information (e.g. Gender, Age, Color, Country,...). Extensive country/language support. Extensible via user-defined plugins. Comprehensive Profiling support.

  semantic-type-detectionsemantic-typecheckingsemantic-typesdatejavadata-discoverydata-profilingdata-profilermetadata
  Language:Java 22

• related-sciences / articat

  articat: data artifact catalog

  data-platformdata-discoverydata-managementdata-catalog
  Language:Python 16

• aist-oceanworks / mudrod

  Mining and Utilizing Dataset Relevancy from Oceanographic Datasets to Improve Data Discovery and Access, online demo: https://mudrod.jpl.nasa.gov/#/

  data-discoverynasasearch-enginerecommendation-systemsemantic-search-engineontology-search
  Language:Java 15

• KarrLab / datanator

  Toolkit for discovering and aggregating data for whole-cell modeling

  systems-biologymathematical-modelingcellsdata-aggregationdata-integrationdata-discovery
  Language:Python 15
• catalog_builder

  unytics / catalog_builder

  Data Catalogs Made Easy

  bigquerydata-catalogdata-discoverydatabricksdbtredshiftsnowflake
  Language:Python 15

• GuinsooLab / darkseal

  A Single place to Discover, Collaborate, and Get your data right

  metadatacatalogdata-catalogdata-discoverydata-platformdata-structuresmetadata-managementmetadata-standardguinsoolabdata-documentationdata-governancedata-lineagedata-securitydata-trustdata-collaborationdata-glossariesdata-compliancedata-alertingdata-notification
  Language:TypeScript 14

• worldbank / wb-nlp-apps

  This repository contains the NLP modeling components and web application implementations of a project for knowledge and data discovery funded by the Knowledge for Change Program (KCP) and the Joint Data Center on Forced Displacement (JDC).

  nlpmachine-learningword2vecldatopic-modelingpythondata-discovery
  Language:Jupyter Notebook 13

• open-metadata / openmetadata-site

  Open Standard for Metadata. A Single place to Discover, Collaborate and Get your data right.

  automationbigdatabigdataanalyticsdata-catalogdata-discoverydata-observabilitydata-profilingdata-quality-monitoringdata-sciencedatadiscoverydataengineeringdataqualitydatasciencedbtgovernancehacktoberfesthacktoberfest2022metadatametadata-apimetadata-management
  Language:CSS 11

• slaclab / datacat

  A system for managing files and file replicas across many diverse sites

  datasetdata-catalogmetadata-storedata-discoverydataset-catalogmetadatadatacat
  Language:Java 10

• michalporeba / odis

  Search in decentralised systems. Search federation, result moderation, aggregation and feedback with hypermedia in ReSTful API to round it all of.

  federatedsearchdiscoverabilitymesh-networksdatadata-discoveryinformation-discovery
  Language:CSS 9

• nightfallai / sensitive-data-scanner

  Scan directories, exports, and backups for sensitive data (like PII and API keys) with Nightfall's data loss prevention (DLP) APIs. Discover what lives at-rest in your data silos.

  data-protectiondata-privacydata-securitydlpdata-loss-preventionnightfalldata-classificationdata-discovery
  Language:Python 9

• delftdata / valentine-system

  Valentine scalable deployment for VLDB demo

  data-discoverydataset-discoveryschema-matchingschema-mapping
  Language:Python 8

• MattTriano / analytics_data_where_house

  An analytics engineering sandbox focusing on real estates prices in Cook County, IL

  airflowdata-engineeringdata-pipelinesdata-warehousingdbteltpythondockermkdocs-materialopen-sourcedata-catalogdata-discoverydata-platformsuperset
  Language:Python 7
• hutch

  HDRUK / hutch

  Former repo for Hutch

  data-discoverydotnetomop-cdm
  Language:C# 4

• lbhm / fainder

  A fast and accurate index for distribution-aware dataset search.

  data-discoverydataset-searchindexdistribution-aware
  Language:Python 4

• opendatadiscovery / odd-collector-gcp

  Open-source GCP metadata collector based on ODD Specification

  data-catalogdata-discoverydata-governancedata-observabilitydata-pipelinesdata-platformdata-profilingdatacataloghacktoberfestlineage
  Language:Python 4