pii

There are 11 repositories under pii topic.

microsoft / presidio
Context aware, pluggable and customizable data protection and de-identification SDK for text and images
data-loss-prevention dlp python pii anonymization privacy data-protection data-anonymization presidio text-anonymization pii-anonymization-service de-identification pii-anonymization data-masking anonymization-service privacy-protection microsoft transformers data-scrubbing pii-detection
Language:Python 3524
capitalone / DataProfiler
What's in your data? Extract schema, statistics and entities from datasets
python privacy pii npi nlp data-science gdpr data-analysis data-labels avro dataprofiling sensitive-data security pandas csv tabular-data dataset network-data graph-data machine-learning
Language:Python 1401
databunker
securitybunker / databunker
Secure Vault for Customer PII/PHI/PCI/KYC Records
anonymization application-server ccpa compliance data-anonymization data-protection database encryption gdpr legaltech passportjs pii piidata privacy privacy-by-design secure-storage security tokenization user-consent vault
Language:Go 1234
redhuntlabs / Octopii
An AI-powered Personal Identifiable Information (PII) scanner.
cybersecurity image-processing machine-learning ocr optical-character-recognition pii pii-detection nlp python blackhat cloud
Language:Python 614
tokern / piicatcher
Scan databases and data warehouses for PII data. Tag tables and columns in data catalogs like Amundsen and Datahub
aws-athena aws-glue pii database data-catalog phi data catalog aws-redshift snowflake python
Language:Python 270
microsoft / presidio-research
This package features data-science related tasks for developing new recognizers for Presidio. It is used for the evaluation of the entire system, as well as for evaluating specific PII recognizers or PII detection models.
natural-language-processing nlp pii privacy spacy flair named-entity-recognition ner deep-learning machine-learning transformers
Language:Python 162
samber / slog-formatter
🚨 slog: Attribute formatting
anonymization error formatter formatting go golang handler log-level logger logging middleware pii slog structured-logging
Language:Go 99
GoogleCloudPlatform / dlp-dataflow-deidentification
Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP
beam dlp dataflow data tokenization pii bigquery
Language:Java 88
EdyVision / pii-codex
A research python package for detecting, categorizing, and assessing the severity of personal identifiable information (PII)
personal-identifiable-information pii pii-detection poetry presidio python3 research research-software research-tool analysis data-analysis python
Language:Python 65
open-privacy / opv
Open Privacy Vault - Secure, Performant, Open Source PII as a Service.
pii privacy security
Language:Go 46
deliciousinsights / mongoose-pii
A Mongoose plugin that lets you transparently cipher stored PII and use securely-hashed passwords
mongodb mongoose mongoose-plugin pii pii-ciphering security bcrypt password passwords
Language:JavaScript 44
apicrafter / metacrafter
Metadata and data identification tool and Python library. Identifies PII, common identifiers, language specific identifiers. Fully customizable and flexible rules
metadata pii pii-detection data-profiling entity-recognition datadiscovery
Language:Python 43
edwardcooper / piidetect
A package to build an end-to-end pipeline for detecting personally identifiable information from text.
nlp pii pii-detection word2vec
Language:Python 41
hawk-eye
rohitcoder / hawk-eye
A powerful scanner to scan your Filesystem, S3, MySQL, Redis, Google Cloud Storage and Firebase storage for PII and sensitive data.
audit auditing cybersecurity datasecurity grc infosec pii scanner secrets-management
Language:Python 41
PovertyAction / PII_detection
Application and python script to identify, remove, and/or recode personally identifiable information (PII) from field experiment datasets.
deidentification pii field-survey natural-language-processing
Language:Python 39
AidanSpeakss / streamer-mode-for-firefox
Hides personal information from pages, similar to Discord's Streamer mode.
firefox-addon privacy pii
Language:JavaScript 27
Poogles / piiregex
Search for PII in Python
pii personally-identifiable-information piiregex python3
Language:Python 26
nightfallai / nightfall-python-sdk
Python Data Loss Prevention (DLP) SDK - Nightfall Developer Platform
data-loss-prevention pii secrets-detection data-protection data-privacy nightfall sdk api data-classification python
Language:Python 25
thoughtworks-datakind / anonymizer
Library for identification, anonymization and de-anonymization of PII data
pii personal-identifiable-information python data-protection data-anonymization
Language:Python 22
philterd / phileas
The PII and PHI redaction engine
anonymize deidentification deidentify phi pii redact redaction personally-identifiable-information protected-health-information java nppi
Language:Java 20
primait / veil
Rust derive macro for redacting sensitive data in std::fmt::Debug
data-mask data-masking data-redaction pii privacy proc-macro redaction rust
Language:Rust 18
apicrafter / metacrafter-registry
Registry of metadata identifier entities like UUID, GUID, person fullname, address and so on. Linked with other sources
metadata metadata-registry entity-recognition entity-registry pii-detection pii entity named-entity-recognition datadiscovery
Language:Python 16
edwardcooper / data-sentry
A project to build a machine learning pipeline to detect personal identifiable information (PII)
pii nlp pii-detection
Language:Jupyter Notebook 16
SemanticBrainCorp / SemanticShield
The Security Toolkit for managing Generative AI(especially LLMs) and Supervised Learning processes(Learning and Inference).
chatgpt jailbreak llm moderation pii adversarial-attacks prompt-engineering prompt-injection security-tools
Language:Python 16
dotfurther / OpenDiscoverSDK
.NET 6 API for document file format identification, text/metadata/attachment/embedded object/sensitive item (PII/PHI)/entity extraction.
text extraction text-extraction sdk metadata embedded-objects file-identification file-format-detection file-deduplication microsoft-office csharp dotnet email archive pst indexing pii pii-detection phi entity-extraction
Language:C# 15
kylemclaren / scrub
A Python package to scrub PII
pii python sanitization
Language:Python 14
OElesin / project-matt
Project Matt: Scan your AWS S3 Buckets for PII Data to Guard against GDPR
aws-batch aws-cloudformation pii piii-filters aws-s3 scala machine-learning elasticsearch redis gdpr
Language:Scala 14
dwisiswant0 / leakz-passive-workflow
Caido's passive workflow to find potential leaked secrets, PII, and sensitive fields.
caido caido-passive-workflow caido-workflow leaks leaks-scanner pii secrets sensitive-data sensitive-data-discovery
Language:JavaScript 13
solodynamo / custom-log-marshaler
Attempt to R.I.P PII or unnecessary info in logs and reduce log ingestion costs in the process.
cost-optimization golang logging pii piidata zap zerolog
Language:Go 13
DataFog / datafog-instructor
local-llm ollama pii pydantic
Language:Python 10
dotfurther / OpenDiscoverPlatformCaseStudy
Case study using dotfurther's Open Discover Platform with the RavenDB document store to rapidly create a full-text search/eDiscovery/information governance capable demonstration application.
text-extraction file-identification pii pii-detection metadata file-deduplication ediscovery information-governance-catalog file-format-detection indexing-engine archive-extractor ravendb personally-identifiable-information full-text-search full-text-extraction information-governance data-breach document-ingestion full-text
10
DataFog / codexify
An open-source API that identifies, masks, and replaces Personallly Identifying Information (PII)
pii pii-data pii-detection synthetic-data synthetic-dataset-generation llm openai openai-chatgpt privacy-enhancing-technologies privacy-protection privacy-tools
Language:Python 9
HabaneroCake / pii-filter
A personally identifiable information (PII) filter.
pii pii-detection dutch
Language:TypeScript 9
sajacy / fcc-ecfs-scrape
Extract FCC ECFS filings to BigQuery
fcc-api python pii vulnerability
Language:Python 9
KeeplerIO / de-identification-framework
Application of our De-identification Framework with open source technologies, enabling enterprises to take ownership of the de-identification process and deploy it in trusted environments.
data de-identification pii data-security privacy-protection datalake-ingestion
Language:Python 8
VirgilSecurity / virgil-purekit-java
PureKit SDK allows developers to protect users' passwords and sensitive personal information in a database from data breaches and both online and offline attacks and make stolen passwords useless even if a database is breached.
phe password sdk password-hardened-encryption passw0rd encryption cryptography gdpr hipaa piidata pii
Language:Java 8

pii

microsoft / presidio

capitalone / DataProfiler

securitybunker / databunker

redhuntlabs / Octopii

tokern / piicatcher

microsoft / presidio-research

samber / slog-formatter

GoogleCloudPlatform / dlp-dataflow-deidentification

EdyVision / pii-codex

open-privacy / opv

deliciousinsights / mongoose-pii

apicrafter / metacrafter

edwardcooper / piidetect

rohitcoder / hawk-eye

PovertyAction / PII_detection

AidanSpeakss / streamer-mode-for-firefox

Poogles / piiregex

nightfallai / nightfall-python-sdk

thoughtworks-datakind / anonymizer

philterd / phileas

primait / veil

apicrafter / metacrafter-registry

edwardcooper / data-sentry

SemanticBrainCorp / SemanticShield

dotfurther / OpenDiscoverSDK

kylemclaren / scrub

OElesin / project-matt

dwisiswant0 / leakz-passive-workflow

solodynamo / custom-log-marshaler

DataFog / datafog-instructor

dotfurther / OpenDiscoverPlatformCaseStudy

DataFog / codexify

HabaneroCake / pii-filter

sajacy / fcc-ecfs-scrape

KeeplerIO / de-identification-framework

VirgilSecurity / virgil-purekit-java