Plagger::Rule::Deduped - Rule to get Deduped entries based on the database

Plagger documentation Contained in the Plagger distribution.

Index

Code Index:

NAME

Top

Plagger::Rule::Deduped - Rule to get Deduped entries based on the database

SYNOPSIS

Top

  # remove entries you already seen
  - module: Filter::Rule
    rule:
      module: Deduped
      path: /tmp/var.db

DESCRIPTION

Top

This rule de-duplicates entry based on cached index (database).

CONFIG

Top

path

Specified path to the database. This config is dependent for the DB_File backend.

compare_body

If set, this rule checks digest of entry, which is a MD5 hash of entry's title with body. Defaults to 0.

AUTHOR

Top

Tatsuhiko Miyagawa

Kazuhiro Osawa created Plagger::Plugin::Cache in early days, which gives me a base idea of this module.

SEE ALSO

Top

Plagger, DB_File

Plagger documentation Contained in the Plagger distribution. 
package Plagger::Rule::Deduped;
use strict;
use base qw( Plagger::Rule );

use UNIVERSAL::require;

sub init {
    my $self = shift;

    $self->{engine} ||= 'DB_File';

    my $class = "Plagger::Rule::Deduped::$self->{engine}";
    $class->require or Plagger->context->error("Error loading $class: $@");

    my $deduper = $class->new($self);
    $self->{deduper} = $deduper;
}

sub id {
    my $self = shift;
    return "Deduped";
}

sub as_title {
    my $self = shift;
    return "Deduped entries";
}

sub dispatch {
    my($self, $args) = @_;

    unless ($args->{entry}) {
        Plagger->context->error("This rule needs entry object to work.");
    }

    my $is_new = $self->{deduper}->is_new($args->{entry});
    $self->{deduper}->add($args->{entry}) if $is_new;

    return $is_new;
}

1;

__END__