Plagger::Rule::Deduped - Rule to get Deduped entries based on the database

  # remove entries you already seen
  - module: Filter::Rule
    rule:
      module: Deduped
      path: /tmp/var.db

This rule de-duplicates entry based on cached index (database).

path

Specified path to the database. This config is dependent for the DB_File backend.

compare_body

If set, this rule checks digest of entry, which is a MD5 hash of entry's title with body. Defaults to 0.

Tatsuhiko Miyagawa

Kazuhiro Osawa created Plagger::Plugin::Cache in early days, which gives me a base idea of this module.

Plagger, DB_File