Privacy-Preserving ML Papers
Research on training and running models without exposing data: differential privacy, federated learning, secure inference and multi-party computation for ML.
Latest issue
Oct 6 · 3 of 12 shownThis issue has 11 items: differential privacy theory and practice, federated learning, and homomorphic encryption for language models. Most worth reading are DP-ES, which stabilises private prompt optimization, and AR-HE, which runs the full decoding loop under encryption on the server. TranScope, a hardware membership-inference attack, was left out because it matches no secondary topic.
Shows that private online learning and private online prediction are separated for classes of finite Littlestone dimension. Every (ε,δ)-private online learner has a stream with expected mistakes of at least Ω((d/ε)·log(T)^{2/3}), while a jointly private predictor makes at most 2^{2^{cd²}}ε⁻² log²(2/(εδ)) expected mistakes independent of T.
Introduces a pipeline that privately learns the mixture of several public datasets to pretrain on before DP finetuning, using a privately learned low-dimensional linear model. On NIH ChestX-ray14 it improved macro AUC by up to 0.037, with +22.8% relative AUC on Cardiomegaly at ε=1. On ENRON it cut test perplexity by 16% against baseline mixtures.
More in Privacy
Streams that already watch this field. Follow one as it is — it costs nothing extra.
Everything in fully homomorphic encryption: new papers and benchmarks, libraries and releases, new projects and startups, funding, products, standards, talks and events, attacks and incidents — across research, industry and onchain FHE.
Everything around FHERMA, the FHE challenge platform by Fair Math: new challenges and prize pools, results and winners, solution write-ups, Polycircuit and OpenFHE-rs releases, partnerships and mentions.
Every new release of the homomorphic encryption libraries, compilers and SDKs — TFHE-rs, Concrete, fhEVM, OpenFHE, SEAL, HEIR, Lattigo, Poulpy, CryptoLab HEaaN and enVector, Desilo, IBM HElayers, Apple Swift HE, TenSEAL and GPU libraries — with what changed.