Genetics

Frozen but Not Always Accessible: A Representation Analysis of Genomic Language Models

Nirjhor Datta, Swakkhar Shatabda, M. Sohel Rahman

Featured August 9, 2026

This analysis was generated by SciGrove. Upload your own PDFs or enter a DOI — and get the same AI breakdown on any paper.

Get started

AI-generated analysis — This is SciGrove's AI interpretation of the paper, not peer-reviewed content. Always refer to the original paper.

Simply

Genomic AI models, when 'frozen' and used as simple feature detectors, work great for big-picture DNA tasks like finding promoters, but struggle with tiny, precise changes like predicting splice sites, suggesting the detailed info is hidden deep inside.

In depth

The paper systematically investigates when frozen genomic language models can be effectively reused as feature extractors for downstream biological tasks without requiring expensive fine-tuning. It reveals a consistent task-dependent pattern: while frozen embeddings perform well on global tasks like promoter prediction, their performance significantly drops for local, position-sensitive tasks such as splice-site and variant-effect prediction. The authors demonstrate that local biological signals are often present in intermediate layers or token-level representations but become less accessible through final pooled embeddings, highlighting the need for better readout strategies or task-specific adaptation for challenging local tasks.

Key Takeaways

1
Frozen genomic language models are highly effective and computationally efficient for global or composition-driven biological tasks, often recovering 95-100% of fine-tuned performance.
2
For local, position-sensitive tasks (e.g., splice-site, variant-effect prediction), frozen representations show significantly lower recovery (e.g., 60-88% for splice sites), indicating that critical information is not always accessible.
3
Local biological signals are partially present in intermediate layers or token-level representations but can be diluted by pooling or poorly organized in the final embedding space, necessitating improved readout functions or encoder adaptation.

Conceptual Flow

HIGH LEVEL

Methodology: How Genomic Models Were Analyzed

The study took pre-trained DNA models, froze their brains, and then added simple classifiers to see if they could still understand different DNA tasks.

DNA Sequence

Pass Through

Frozen AI Model

Extracted Features

Results: Global vs. Local Task Performance

They found that frozen models were almost as good as fully trained ones for big-picture tasks, but much worse for tasks needing super-fine detail.

Global Tasks

Local Tasks

Compare Performance

High Accuracy

Lower Accuracy