pii

There are 11 repositories under pii topic.

• microsoft / presidio

  An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

  pythonpiiprivacydata-anonymizationde-identificationdata-maskingtransformerspii-detectiondata-obfuscationdata-privacydata-redactionguardrailsimage-redactornamed-entity-recognitionnlppersonally-identifiable-informationphisensitive-dataspacyanonymization
  Language:Python 5561

• CatchTheTornado / text-extract-api

  Document (PDF, Word, PPTX ...) extraction and parse API using state of the art modern OCRs + Ollama supported models. Anonymize documents. Remove PII. Convert any document or picture to structured JSON or Markdown

  apiextractjsonllmpdfanonymizationocrocr-pythonpii
  Language:Python 2873

• capitalone / DataProfiler

  What's in your data? Extract schema, statistics and entities from datasets

  pythonprivacypiinpinlpdata-sciencegdprdata-analysisdata-labelsavrodataprofilingsensitive-datasecuritypandascsvtabular-datadatasetnetwork-datagraph-datamachine-learning
  Language:Python 1516
• databunker

  securitybunker / databunker

  Secure Vault for Customer PII/PHI/PCI/KYC Records

  gdprpiipiidatasecurityprivacyprivacy-by-designuser-consentccpacompliancelegaltechanonymizationdata-anonymizationdatabaseencryptionvaulttokenizationapplication-serverpassportjsdata-protectionsecure-storage
  Language:Go 1330

• redhuntlabs / Octopii

  An AI-powered Personal Identifiable Information (PII) scanner.

  cybersecurityimage-processingmachine-learningocroptical-character-recognitionpiipii-detectionnlppythonblackhatcloud
  Language:Python 693
• hawk-eye

  rohitcoder / hawk-eye

  A powerful scanner to scan your Filesystem, S3, MySQL, Redis, Google Cloud Storage and Firebase storage for PII and sensitive data.

  auditauditingcybersecuritydatasecuritygrcinfosecpiiscannersecrets-management
  Language:Python 445

• tokern / piicatcher

  Scan databases and data warehouses for PII data. Tag tables and columns in data catalogs like Amundsen and Datahub

  aws-athenaaws-glueaws-redshiftcatalogdatadata-catalogdatabasephipiipythonsnowflake
  Language:Python 306

• microsoft / presidio-research

  This package features data-science related tasks for developing new recognizers for Presidio. It is used for the evaluation of the entire system, as well as for evaluating specific PII recognizers or PII detection models.

  deep-learningflairmachine-learningnamed-entity-recognitionnatural-language-processingnernlppiiprivacyspacytransformers
  Language:Jupyter Notebook 196

• samber / slog-formatter

  🚨 slog: Attribute formatting

  anonymizationerrorformatterformattinggogolanghandlerlog-levelloggerloggingmiddlewarepiislogstructured-logging
  Language:Go 194

• GoogleCloudPlatform / dlp-dataflow-deidentification

  Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP

  beamdlpdataflowdatatokenizationpiibigquery
  Language:Java 95

• klouddb / klouddbshield

  KloudDB Shield is a comprehensive Postgres Security Tool - PII Scanner , CIS Benchmarks , SSL audit , 12+ features .. Supports Postgres, RDS ,Aurora, MySQL

  auroraciscis-benchmarkcis-benchmarkspostgrespostgresqlrds-mysqlrds-postgressecuritypiipiiscanner
  Language:Go 87

• EdyVision / pii-codex

  A research python package for detecting, categorizing, and assessing the severity of personal identifiable information (PII)

  personal-identifiable-informationpiipii-detectionpoetrypresidiopython3researchresearch-softwareresearch-toolanalysisdata-analysispython
  Language:Python 85

• amanvirparhar / elara

  A simple tool to anonymize LLM prompts.

  anonymizationglinerpii
  Language:Svelte 58
• redacted

  polentino / redacted

  Scala library and compiler plugin that prevent inadvertent leakage of sensitive fields in `case classes` (such as credentials, personal data, and other confidential information)

  dotty-plugingdprpiiprivacyprivacy-toolsscalascala-pluginscala3scala3-plugin
  Language:Scala 51

• open-privacy / opv

  Open Privacy Vault - Secure, Performant, Open Source PII as a Service.

  piiprivacysecurity
  Language:Go 50

• deliciousinsights / mongoose-pii

  A Mongoose plugin that lets you transparently cipher stored PII and use securely-hashed passwords

  mongodbmongoosemongoose-pluginpiipii-cipheringsecuritybcryptpasswordpasswords
  Language:JavaScript 45

• apicrafter / metacrafter

  Metadata and data identification tool and Python library. Identifies PII, common identifiers, language specific identifiers. Fully customizable and flexible rules

  metadatapiipii-detectiondata-profilingentity-recognitiondatadiscovery
  Language:Python 44

• edwardcooper / piidetect

  A package to build an end-to-end pipeline for detecting personally identifiable information from text.

  nlppiipii-detectionword2vec
  Language:Python 44

• PovertyAction / PII_detection

  Application and python script to identify, remove, and/or recode personally identifiable information (PII) from field experiment datasets.

  deidentificationpiifield-surveynatural-language-processing
  Language:Python 44

• jftuga / deidentification

  Deidentify people's names and gender specific pronouns

  deidentificationdeidentifynamed-entity-recognitionnatural-language-processingnernlppython3anonymizationdata-anonymizationdata-scrubbingde-identificationpiipii-anonymizationtext-anonymizationpython
  Language:Python 41

• philterd / phileas

  The open source PII and PHI redaction engine

  anonymizedeidentificationdeidentifyphipiiredactredactionpersonally-identifiable-informationprotected-health-informationjavanppi
  Language:Java 38

• AgenticA5 / A5-PII-Anonymizer

  Desktop App with Built-In LLM for Removing Personal Identifiable Information in Documents

  aiai-safetyalmanonymisationanonymityanonymizationartificial-intelligencedesktop-applicationgdprhipaallmpiiprivacyreasoningelectronelectron-desktoplinuxmacospersonal-identifiable-informationwindows
  Language:JavaScript 36

• DataFog / datafog-python

  Lightning-fast PII detection and anonymization library with 190x performance advantage - detect emails, SSNs, names, and more in <2MB package

  data-privacyenterprise-readygdpr-complianthipaanlpperformancepii-detectorpython-libraryregex
  Language:Python 30

• AidanSpeakss / streamer-mode-for-firefox

  Hides personal information from pages, similar to Discord's Streamer mode.

  firefox-addonprivacypii
  Language:JavaScript 28

• Poogles / piiregex

  Search for PII in Python

  piipersonally-identifiable-informationpiiregexpython3
  Language:Python 28

• nightfallai / nightfall-python-sdk

  Python Data Loss Prevention (DLP) SDK - Nightfall Developer Platform

  data-loss-preventionpiisecrets-detectiondata-protectiondata-privacynightfallsdkapidata-classificationpython
  Language:Python 25

• kylemclaren / scrub

  A Python package to scrub PII

  piipythonsanitization
  Language:Python 24

• mddunlap924 / PII-Detection

  Personal Identifiable Information (PII) entity detection and performance enhancement with synthetic data generation

  fine-tuningkaggle-competitionllama3llmnamed-entity-recognitionnerpiipii-datapii-detectionprompt-engineering
  Language:Python 24

• primait / veil

  Rust derive macro for redacting sensitive data in std::fmt::Debug

  data-maskdata-maskingdata-redactionpiiprivacyproc-macroredactionrust
  Language:Rust 23

• thoughtworks-datakind / anonymizer

  Library for identification, anonymization and de-anonymization of PII data

  piipersonal-identifiable-informationpythondata-protectiondata-anonymization
  Language:Python 22

• SemanticBrainCorp / SemanticShield

  The Security Toolkit for managing Generative AI(especially LLMs) and Supervised Learning processes(Learning and Inference).

  chatgptjailbreakllmmoderationpiiadversarial-attacksprompt-engineeringprompt-injectionsecurity-tools
  Language:Python 21

• apicrafter / metacrafter-registry

  Registry of metadata identifier entities like UUID, GUID, person fullname, address and so on. Linked with other sources

  metadatametadata-registryentity-recognitionentity-registrypii-detectionpiientitynamed-entity-recognitiondatadiscovery
  Language:Python 17

• dwisiswant0 / leakz-passive-workflow

  Caido's passive workflow to find potential leaked secrets, PII, and sensitive fields.

  caidocaido-passive-workflowcaido-workflowleaksleaks-scannerpiisecretssensitive-datasensitive-data-discovery
  Language:JavaScript 17

• dotfurther / OpenDiscoverSDK

  .NET 8 API for document file format identification, text/metadata/attachment/embedded object/sensitive item (PII/PHI)/entity extraction.

  textextractiontext-extractionsdkmetadataembedded-objectsfile-identificationfile-format-detectionfile-deduplicationmicrosoft-officecsharpdotnetemailarchivepstindexingpiipii-detectionphientity-extraction
  Language:C# 16

• MLukman / Keycloak-PII-Data-Encryption-Provider

  A Keycloak provider that enables encryption of user attributes that contain PII data to be automatically encrypted upon storing to database and then decrypted upon loading from database

  keycloak-providerpiipii-anonymization
  Language:Java 16

• seanpedrick-case / doc_redaction

  Redact PDF/image-based documents, or CSV/XLSX files using a Gradio-based GUI interface

  documentspiipii-detectionredaction
  Language:Python 16