> For the complete documentation index, see [llms.txt](https://aviznetworks.gitbook.io/asn/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://aviznetworks.gitbook.io/asn/getting-started/asn-features/deduplication.md).

# Deduplication

Packet deduplication is a feature used to identify and eliminate duplicate network packets, improving network efficiency and reducing redundant data processing. It works by comparing incoming packets.

<figure><img src="https://3684695773-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FIPuwYU8kWKXe85bX1sjR%2Fuploads%2FjwC5VmCZCq3wQDxVXF3J%2Fimage.png?alt=media&amp;token=6c06ecb1-639b-4888-97a3-411eee205b89" alt=""><figcaption></figcaption></figure>

* Deduplication Process: Traffic is continuously analysed in real-time with a granularity of up to 8 milliseconds, enabling the rapid detection and elimination of duplicate packets. The analysis process begins by inspecting ingress packets for familiarity based on their type and fields. If a packet is found to exist within the customer-defined time frame, it is identified as a duplicate and dropped. Users can configure the Packet Source (Full or Routed Packet) to filter out redundant traffic, even across multiple hops. Anchor & Offset settings define where and how packet data is compared, while the Window Size (2-8ms) ensures efficient real-time deduplication. For detailed configuration, refer to this link [GitBook](https://aviznetworks.gitbook.io/asn/aviz-service-node-graphical-user-interface-guide/configuration/configuring-deduplication).

<br>