| HTML-WikiConverter documentation | Contained in the HTML-WikiConverter distribution. |
HTML::WikiConverter - Convert HTML to wiki markup
use HTML::WikiConverter;
my $wc = new HTML::WikiConverter( dialect => 'MediaWiki' );
print $wc->html2wiki( html => '<b>text</b>' ), "\n\n";
# A more complete example
my $html = qq(
<p><i>Italic</i>, <b>bold</b>, <span style="font-weight:bold">also bold</span>, etc.</p>
);
my @dialects = HTML::WikiConverter->available_dialects;
foreach my $dialect ( @dialects ) {
my $wc = new HTML::WikiConverter( dialect => $dialect );
my $wiki = $wc->html2wiki( html => $html );
printf "The %s dialect gives:\n\n%s\n\n", $dialect, $wiki;
}
HTML::WikiConverter is an HTML to wiki converter. It can convert
HTML source into a variety of wiki markups, called wiki
"dialects". The following dialects are supported:
DokuWiki Kwiki MediaWiki MoinMoin Oddmuse PbWiki PhpWiki PmWiki SlipSlap TikiWiki UseMod WakkaWiki WikkaWiki
Note that while dialects usually produce satisfactory wiki markup, not all features of all dialects are supported. Consult individual dialects' documentation for details of supported features. Suggestions for improvements, especially in the form of patches, are very much appreciated.
my $wc = new HTML::WikiConverter( dialect => $dialect, %attrs );
Returns a converter for the specified wiki dialect. Croaks if
$dialect is not provided or its dialect module is not installed on
your system. Additional attributes may be specified in %attrs; see
"ATTRIBUTES" for a complete list.
$wiki = $wc->html2wiki( $html, %attrs ); $wiki = $wc->html2wiki( html => $html, %attrs ); $wiki = $wc->html2wiki( file => $file, %attrs ); $wiki = $wc->html2wiki( uri => $uri, %attrs );
Converts HTML source to wiki markup for the current dialect. Accepts
either an HTML string $html, an file $file, or a URI <$uri> to
read from.
Attributes assigned in %attrs (see "ATTRIBUTES") will augment
or override previously assigned attributes for the duration of the
html2wiki() call.
my $ancestor = $wc->elem_search_lineage( $node, \%rules );
Searches the lineage of $node and returns the first ancestor node
that has rules matching those specified in %rules, or undef if
no matching node is found.
For example, to find out whether $node has an ancestor with rules
matching { block =>1 }, one could use:
if( $wc->elem_search_lineage( $node, { block => 1 } ) ) {
# do something
}
my $html = $wc->given_html;
Returns the HTML passed to or fetched (ie, from a file or URI) by the
last html2wiki() method call. Useful for debugging.
my $parsed_html = $wc->parsed_html;
Returns a string containing the post-processed HTML from the last
html2wiki call. Post-processing includes parsing by
HTML::TreeBuilder, CSS normalization by
HTML::WikiConverter::Normalizer, and calls to the preprocess and
preprocess_tree dialect methods.
my @dialects = HTML::WikiConverter->available_dialects;
Returns a list of all available dialects by searching the directories
in @INC for HTML::WikiConverter:: modules.
my $rules = $wc->rules_for_tag( $tag );
Returns the rules that will be used for converting elements of the
given tag. Follows alias references. Note that the rules used for a
particular tag may depend on the current set of attributes being used.
You may configure HTML::WikiConverter using a number of
attributes. These may be passed as arguments to the new
constructor, or can be called as object methods on an H::WC object.
Some dialects allow other attributes in addition to those below, and may override the attributes' default values. Consult the dialect's documentation for details.
URI to use for converting relative URIs to absolute ones. This
effectively ensures that the src and href attributes of image
and anchor tags, respectively, are absolute before converting the HTML
to wiki markup, which is necessary for wiki dialects that handle
internal and external links separately. Relative URIs are only
converted to absolute ones if the base_uri argument is
present. Defaults to undef.
(Required) Dialect to use for converting HTML into wiki markup. See
the "DESCRIPTION" section above for a list of dialects. new()
will fail if the dialect given is not installed on your system. Use
available_dialects() to list installed dialects.
Specifies the encoding used by the HTML to be converted. Also
determines the encoding of the wiki markup returned by the
html2wiki method. Defaults to "utf8".
Passing escape_entities a true value uses HTML::Entities to
encode potentially unsafe '<', '>', and '&' characters.
Defaults to true.
Boolean indicating whether HTML::TreeBuilder will use strict
handling of paragraph tags when parsing HTML input. (This corresponds
to the p_strict method in the HTML::TreeBuilder module.) Enabled
by default.
Code reference that gets invoked after HTML is parsed but before it is
converted into wiki markup. The callback is passed two arguments: the
HTML::WikiConverter object and a HTML::Element pointing to the
root node of the HTML tree created by HTML::TreeBuilder.
Boolean that, if enabled, bypasses HTML::Parser's incremental
parsing (thus slurping the file in all at once) of files when
reading HTML files. If File::Slurp is installed, its read_file()
function will be used to perform slurping; otherwise, a common Perl
idiom will be used for slurping instead. This option is only used if
you call html2wiki() with the file argument.
Specifies the LWP::UserAgent object to be used when fetching the
URI passed to html2wiki(). If unspecified and html2wiki() is
passed a URI, a default user agent will be created.
Takes a URI, regular expression, or coderef (or a reference to an
array of elements of these types) used to determine which links are to
wiki pages: a link whose href parameter matches wiki_uri will be
treated as a link to a wiki page. In addition, wiki_uri will be
used to extract the title of the wiki page. The way this is done
depends on whether the wiki_uri has been set to a string, regexp,
or coderef. The default is undef, meaning that all links will be
treated as external links by default.
If wiki_uri is a string, it is interpreted as a URI template, and
it will be assumed that URIs to wiki pages are created by joining
wiki_uri with the wiki page title. For example, the English
Wikipedia might use "http://en.wikipedia.org/wiki/" as the value of
wiki_uri. Ward's wiki might use "http://c2.com/cgi/wiki?". These
examples use an absolute wiki_uri, but a relative URI can be used
as well; an absolute URI will be created based on the value of
base_uri. For example, the Wikipedia example above can be rewritten
using base_uri of "http://en.wikipedia.org" and a wiki_uri of
"/wiki/".
wiki_uri can also be a regexp that matches URIs to wiki pages and
also extracts the page title from them. For example, the English
Wikipedia might use
qr~http://en\.wikipedia\.org/w/index\.php\?title\=([^&]+)~.
wiki_uri can also be a coderef that takes the current
HTML::WikiConverter object and a URI object. It should return
the title of the wiki page extracted from the URI, or undef if the
URI doesn't represent a link to a wiki page.
As mentioned above, the wiki_uri attribute can either take a single
URI/regexp/coderef element or it may be assigned a reference to an
array of any number of these elements. This is useful for wikis that
have different ways of creating links to wiki pages. For example, the
English Wikipedia might use:
my $wc = new HTML::WikiConverter(
dialect => 'MediaWiki',
wiki_uri => [
'http://en.wikipiedia.org/wiki/',
sub { pop->query_param('title') } # requires URI::QueryParam
]
);
Helps HTML::TreeBuilder parse HTML fragments by wrapping HTML in
<html> and </html> before passing it through
html2wiki. Boolean, enabled by default.
Consult HTML::WikiConverter::Dialects for documentation on how to
write your own dialect module for HTML::WikiConverter. Or if you're
not up to the task, drop me an email and I'll have a go at it when I
get a spare moment.
David J. Iberri, <diberri@cpan.org>
Please report any bugs or feature requests to
bug-html-wikiconverter at rt.cpan.org, or through the web interface at
http://rt.cpan.org/NoAuth/ReportBug.html?Queue=HTML-WikiConverter.
I will be notified, and then you'll automatically be notified of progress on
your bug as I make changes.
You can find documentation for this module with the perldoc command.
perldoc HTML::WikiConverter
You can also look for information at:
Thanks to Tatsuhiko Miyagawa for suggesting
Bundle::HTMLWikiConverter as well as providing code for the
available_dialects() class method.
My thanks also goes to Martin Kudlvasr for catching (and fixing!) a bug in the logic of how HTML files were processed.
Big thanks to Dave Schaefer for the PbWiki dialect and for the idea
behind the new attributes() implementation.
Copyright (c) David J. Iberri, all rights reserved.
This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.
| HTML-WikiConverter documentation | Contained in the HTML-WikiConverter distribution. |
package HTML::WikiConverter; use warnings; use strict; use Params::Validate ':all'; use HTML::WikiConverter::Normalizer; use HTML::TreeBuilder; use HTML::Entities; use HTML::Tagset; use File::Spec; use DirHandle; use Encode; use Carp; use URI::Escape; use URI; our $VERSION = '0.68'; our $AUTOLOAD;
sub new { my $pkg = shift; return $pkg->__new_dialect(@_) if $pkg eq __PACKAGE__; my $self = bless { }, $pkg; $self->__load_attribute_specs(); $self->__setup(@_); return $self; } sub __new_dialect { my( $pkg, %opts ) = @_; croak "Required 'dialect' parameter is missing" unless $opts{dialect}; my @dialect_classes = ( __PACKAGE__.'::'.$opts{dialect}, $opts{dialect} ); foreach my $dialect_class ( @dialect_classes ) { return $dialect_class->new( %opts ) if eval "use $dialect_class; 1" or $dialect_class->isa($pkg); } my $dc_list = join ', ', @dialect_classes; croak "Dialect '$opts{dialect}' could not be loaded (tried $dc_list). Error: $@"; } sub __setup { my $self = shift; $self->__setup_attributes(@_); $self->__setup_rules(); } sub __setup_attributes { my $self = shift; $self->__attrs( {} ); $self->__load_and_validate_attributes(@_); } sub __setup_rules { my $self = shift; $self->__load_rules(); $self->__validate_rules(); } sub __original_attrs { shift->_attr( { internal => 1 }, __original_attrs => @_ ) } sub __attrs { shift->_attr( { internal => 1 }, __attrs => @_ ) } sub __attrs_changed { shift->_attr( { internal => 1 }, __attrs_changed => @_ ) } sub __root { shift->_attr( { internal => 1 }, __root => @_ ) } sub __rules { shift->_attr( { internal => 1 }, __rules => @_ ) } sub __attribute_specs { shift->_attr( { internal => 1 }, __attribute_specs => @_ ) } # Unsupported attributes sub base_url { shift->__no_such( attribute => qw/ base_url base_uri / ) } sub wiki_url { shift->__no_such( attribute => qw/ wiki_url wiki_uri / ) } sub __no_such { my( $self, $thing, $that, $this ) = @_; croak "'$that' is not a valid $thing. Perhaps you meant '$this'?"; } # Pass '{internal=>1}' as first arg for params that aren't attributes sub _attr { my( $self, $opts, $param, @value ) = ref $_[1] eq 'HASH' ? @_ : ( +shift, {}, @_ ); my $store = $opts->{internal} ? $self : $self->__attrs; if( @value ) { eval { validate_pos( @value, $self->__attribute_specs->{$param} ) unless $opts->{internal} }; $self->__attribute_error($@) if $@; $store->{$param} = $value[0]; $self->__attrs_changed(1) if !$opts->{internal}; } return defined $store->{$param} ? $store->{$param} : ''; } # Attribute accessors and mutators sub AUTOLOAD { my $self = shift; ( my $attr = $AUTOLOAD ) =~ s/.*://; return $self->_attr( $attr => @_ ) if exists $self->__attribute_specs->{$attr}; croak "Can't locate method '$attr' in package ".ref($self); } # So AUTOLOAD doesn't intercept calls to destruction method sub DESTROY { } sub __slurp { my( $self, $file ) = @_; eval "use File::Slurp;"; return $self->__simple_slurp($file) if $@; return scalar File::Slurp::read_file($file); } sub __simple_slurp { my( $self, $file ) = @_; open my $fh, $file or croak "can't open file $file for reading: $!"; my $text = do { local $/; <$fh> }; close $fh; return $text; }
sub html2wiki { my $self = shift; # Assumes that if @_ is odd-numbered, its first element is html my %args = @_ % 2 ? ( html => +shift, @_ ) : @_; my %common_arg_errors = ( url => 'uri', base_url => 'base_uri', wiki_url => 'wiki_uri' ); while( my( $bad, $good ) = each %common_arg_errors ) { $self->__no_such( 'argument to html2wiki()', $bad, $good ) if exists $args{$bad}; } my @input_sources = grep { exists $args{$_} } qw/ html file uri /; croak "missing 'html', 'file', or 'uri' argument to html2wiki" unless @input_sources; croak "more than one of 'html', 'file', or 'uri' provided, but only one input source allowed" if @input_sources > 1; my $html = delete $args{html} || ''; my $file = delete $args{file} || ''; my $uri = delete $args{uri} || ''; $html = $self->__slurp($file) if $file && $self->slurp; $html = $self->__fetch_html_from_uri($uri) if $uri; # may set 'user_agent' attrib, so call before storing attribs $html = "<html>$html</html>" if $html and $self->wrap_in_html; $self->__original_attrs( { %{ $self->__attrs } } ); $self->$_( $args{$_} ) foreach keys %args; $self->__setup_rules() if $self->__attrs_changed; # Decode into Perl's internal form $html = decode( $self->encoding, $html ); my $tree = new HTML::TreeBuilder(); $tree->store_comments(1); $tree->p_strict( $self->p_strict ); $tree->implicit_body_p_tag(1); $tree->ignore_unknown(0); # <ruby> et al # Parse the HTML string or file if( $html ) { $self->given_html( $html ); $tree->parse($html); $tree->eof(); } else { $self->given_html( $self->__slurp($file) ); $tree->parse_file($file); } # Preprocess, save tree and parsed HTML $self->__root( $tree ); $self->__preprocess_tree(); $self->__root->deobjectify_text(); $self->parsed_html( $tree->as_HTML(undef, ' ', {}) ); $self->__root->objectify_text(); # Convert and preprocess my $output = $self->__wikify($tree); $self->__postprocess_output(\$output); # Avoid leaks $tree->delete(); # Return to original encoding $output = encode( $self->encoding, $output ); if( $self->__attrs_changed ) { $self->__attrs( { %{ $self->__original_attrs } } ); $self->__setup_rules(); $self->__attrs_changed(0); } return $output; } sub __wikify { my( $self, $node ) = @_; # Concatenate adjacent text nodes $node->normalize_content(); if( $node->tag eq '~text' ) { return $node->attr('text'); } elsif( $node->tag eq '~comment' ) { return '<!--' . $node->attr('text') . '-->'; } else { my $rules = $self->rules_for_tag( $node->tag ); return $self->__subst($rules->{replace}, $node, $rules) if exists $rules->{replace}; # Set private preserve rules if( $rules->{preserve} ) { $rules->{__start} = \&__preserve_start, $rules->{__end} = $rules->{empty} ? undef : '</'.$node->tag.'>'; } elsif( $rules->{passthrough} ) { $rules->{__start} = ''; $rules->{__end} = ''; } # Recurse my $output = $self->get_elem_contents($node); # Unspecified tags have their whitespace preserved (this allows # 'html' and 'body' tags [among others] to keep formatting when # inner tags like 'pre' need to preserve whitespace). my $trim = $rules->{trim} || 'none'; $output =~ s/^\s+// if $trim eq 'both' or $trim eq 'leading'; $output =~ s/\s+$// if $trim eq 'both' or $trim eq 'trailing'; my $lf = $rules->{line_format} || 'none'; $output =~ s/^\s*\n/\n/gm if $lf ne 'none'; if( $lf eq 'blocks' ) { $output =~ s/\n{3,}/\n\n/g; } elsif( $lf eq 'multi' ) { $output =~ s/\n{2,}/\n/g; } elsif( $lf eq 'single' ) { $output =~ s/\n+/ /g; } elsif( $lf eq 'none' ) { # Do nothing } # Substitutions $output =~ s/^/$self->__subst($rules->{line_prefix}, $node, $rules)/gem if $rules->{line_prefix}; $output = $self->__subst($rules->{__start}, $node, $rules).$output if $rules->{__start}; $output = $output.$self->__subst($rules->{__end}, $node, $rules) if $rules->{__end}; $output = $self->__subst($rules->{start}, $node, $rules).$output if $rules->{start}; $output = $output.$self->__subst($rules->{end}, $node, $rules) if $rules->{end}; # If the current element is a block and is contained within # another block element, then we will not block the current # element by default. However, if the current element is a block # and is contained within another block element that specifies a # line_format of 'blocks', then we will block the current element. $output = "\n\n$output\n\n" if $rules->{block} && ( ! $self->elem_search_lineage( $node, { block => 1 } ) or $self->elem_search_lineage( $node, { line_format => 'blocks' } ) ); # ...but they are put on their own line $output = "\n$output" if $rules->{block} and $node->parent->look_up( _tag => $node->tag ) and $trim ne 'none'; return $output; } } # Deprecated. Instead use elem_search_lineage( $node, { block => 1 } ). sub elem_within_block { my( $self, $node ) = @_; foreach my $n ( $node->lineage ) { return $n if $self->rules_for_tag($n->tag || '')->{block}; } return 0; }
sub elem_search_lineage { my( $self, $node, $search_rules ) = @_; foreach my $n ( $node->lineage ) { my $rules = $self->rules_for_tag( $n->tag ); my $matched = 1; while( my($k,$v) = each %$search_rules ) { my $rule_value = $rules->{$k} || ''; $matched = 0 unless $v eq $rule_value; } return $n if $matched; } return undef; } sub __subst { my( $self, $subst, $node, $rules ) = @_; return ref $subst eq 'CODE' ? $subst->( $self, $node, $rules ) : $subst; } sub __preserve_start { my( $self, $node, $rules ) = @_; my $tag = $node->tag; my @attrs = exists $rules->{attributes} ? @{$rules->{attributes}} : ( ); my $attr_str = $self->get_attr_str( $node, @attrs ); my $slash = $rules->{empty} ? ' /' : ''; return '<'.$tag.' '.$attr_str.$slash.'>' if $attr_str; return '<'.$tag.$slash.'>'; } # Maps a tag name to its URI attribute my %rel2abs = ( a => 'href', img => 'src' ); my %allowedEmptyTag = ( %HTML::Tagset::emptyElement, '~comment' => 1, '~text' => 1 ); my %isKnownTag = %HTML::Tagset::isKnown; sub __preprocess_tree { my $self = shift; $self->__root->objectify_text(); $self->preprocess_tree($self->__root); HTML::WikiConverter::Normalizer->new->normalize($self->__root) if $self->normalize; my %strip_tag = map { $_ => 1 } @{ $self->strip_tags || [] }; my %passthrough_naked_tags = map { $_ => 1 } $self->__passthrough_naked_tags; foreach my $node ( $self->__root->descendents ) { $node->tag('') unless $node->tag; $node->delete, next if $strip_tag{$node->tag}; $node->replace_with_content->delete, next if $passthrough_naked_tags{$node->tag} and !$node->all_external_attr_names; $self->__rm_invalid_text($node); $node->delete, next if $self->strip_empty_tags and !$allowedEmptyTag{$node->tag} and $self->__elem_is_empty($node); $self->__encode_entities($node) if $node->tag eq '~text' and $self->escape_entities; $self->__rel2abs($node) if $self->base_uri and exists $rel2abs{$node->tag}; $self->preprocess_node($node); } # Reobjectify in case preprocessing added new text $self->__root->objectify_text(); $self->preprocess->( $self->__root ) if ref $self->preprocess; } sub __passthrough_naked_tags { my $self = shift; my @tags; if( ref $self->passthrough_naked_tags eq 'ARRAY' ) { @tags = @{ $self->passthrough_naked_tags }; } elsif( $self->passthrough_naked_tags ) { @tags = $self->__default_passthrough_naked_tags; } else { @tags = ( ); } return @tags; } # (bug #28402) sub __default_passthrough_naked_tags { qw/ tbody thead span div font / } sub __elem_is_empty { my( $self, $node ) = @_; my $content = $self->get_elem_contents($node); my $has_nonwhitespace = $content && length $content ? $content =~ /\S/ : 0; return !$has_nonwhitespace; } sub __fetch_html_from_uri { my( $self, $uri ) = @_; my $ua = $self->__user_agent; my $res = $ua->get($uri); croak "request for <$uri> failed" unless $res->is_success; my $encoding = $self->encoding || $self->__guess_encoding($res) || 'utf-8'; my $html = encode( $self->encoding, decode( $encoding, $res->content ) ); return $html; } sub __guess_encoding { my( $self, $res ) = @_; carp "LWP::Charset is not installed but is required for determining the charset claimed by the content at the requested URI", return unless eval "use LWP::Charset; 1"; return LWP::Charset::getCharset($res); } sub __user_agent { my $self = shift; $self->user_agent( $self->__default_user_agent ) unless $self->user_agent; return $self->user_agent; } sub __default_user_agent { croak "LWP is not installed but is required for fetching URIs" unless eval "use LWP::UserAgent; 1"; return LWP::UserAgent->new( agent => shift->__default_ua_string ); } sub __default_ua_string { "html2wiki/$VERSION" } # Encodes high-bit and control chars in node's text to HTML entities. sub __encode_entities { my( $self, $node ) = @_; my $text = defined $node->attr('text') ? $node->attr('text') : ''; encode_entities( $text, '<>&' ); $node->attr( text => $text ); } # Convert relative to absolute URIs sub __rel2abs { my( $self, $node ) = @_; my $attr = $rel2abs{$node->tag}; return unless $node->attr($attr); # don't add attribute if it's not already there $node->attr( $attr => uri_unescape( URI->new_abs( $node->attr($attr), $self->base_uri )->as_string ) ); } # Removes text nodes directly inside container elements. my %containers = map { $_ => 1 } qw/ table tbody tr ul ol dl menu /; sub __rm_invalid_text { my( $self, $node ) = @_; my $tag = defined $node->tag ? $node->tag : ''; if( $containers{$tag} ) { $_->delete for grep { $_->tag eq '~text' } $node->content_list; } } sub strip_aname { my( $self, $node ) = @_; return if $node->attr('href'); $node->replace_with_content->delete(); } sub caption2para { my( $self, $node ) = @_; my $table = $node->parent; $node->detach(); $table->preinsert($node); $node->tag('p'); } sub preprocess_tree { } sub preprocess_node { } sub __postprocess_output { my( $self, $outref ) = @_; $$outref =~ s/\n[\s^\n]+\n/\n\n/g; # XXX this is causing bug 14527 $$outref =~ s/\n{2,}/\n\n/g; $$outref =~ s/^\n+//; $$outref =~ s/\s+$//; $$outref =~ s/[ \t]+$//gm; $self->postprocess_output($outref); } sub postprocess_output { } sub attributes { {} } sub __load_attribute_specs { my $self = shift; # Get default attribute specs my $default_specs = $self->__default_attribute_specs; # Get dialect attribute specs my @dialect_specs = $self->attributes; my $dialect_specs = @dialect_specs == 1 && ref $dialect_specs[0] eq 'HASH' ? $dialect_specs[0] : {@dialect_specs}; my %attr_specs = %$default_specs; while( my( $attr, $spec ) = each %$dialect_specs ) { $attr_specs{$attr} = $spec; } $self->__attribute_specs( \%attr_specs ); } sub __load_and_validate_attributes { my $self = shift; my %attrs = eval { validate( @_, $self->__attribute_specs ) }; $self->__attribute_error($@) if $@; while( my( $attr, $value ) = each %attrs ) { $self->$attr($value); } } sub __attribute_error { my( $self, $error ) = @_; # Validating attributes failed, so we don't have access to the # 'dialect' attribute; obtain it from the package name instead ( my $dialect = ref $self ) =~ s/.*://; $error = sprintf "The attribute '%s' does not exist in the dialect '%s'.", $1, $dialect if $error =~ /not listed in the validation options\: (\w+)/; croak $error; } sub rules { {} } sub __load_rules { my $self = shift; $self->__rules( $self->rules ); } # Rules for validating rules my %meta_rules = ( trim => { range => [ qw/ none both leading trailing / ] }, line_format => { range => [ qw/ none single multi blocks / ] }, replace => { singleton => 1 }, alias => { singleton => 1 }, attributes => { depends => [ qw/ preserve / ] }, empty => { depends => [ qw/ preserve / ] }, passthrough => { singleton => 1 }, ); sub __validate_rules { my $self = shift; foreach my $tag ( keys %{ $self->__rules } ) { my $rules = $self->__rules->{$tag}; foreach my $opt ( keys %$rules ) { my $spec = $meta_rules{$opt} or next; my $singleton = $spec->{singleton} || 0; my @disallows = ref $spec->{disallows} eq 'ARRAY' ? @{ $spec->{disallows} } : ( ); my @depends = ref $spec->{depends} eq 'ARRAY' ? @{ $spec->{depends} } : ( ); my @range = ref $spec->{range} eq 'ARRAY' ? @{ $spec->{range} } : ( ); my %range = map { $_ => 1 } @range; $self->__rule_error( $tag, "'$opt' cannot be combined with any other option" ) if $singleton and keys %$rules != 1; $rules->{$_} && $self->__rule_error( $tag, "'$opt' cannot be combined with '$_'" ) foreach @disallows; ! $rules->{$_} && $self->__rule_error( $tag, "'$opt' must be combined with '$_'" ) foreach @depends; $self->__rule_error( $tag, "Unknown '$opt' value '$rules->{$opt}'. '$opt' must be one of ", join(', ', map { "'$_'" } @range) ) if @range and ! exists $range{$rules->{$opt}}; } } } sub __rule_error { my( $self, $tag, @msg ) = @_; my $dialect = ref $self; croak @msg, " in tag '$tag', dialect '$dialect'.\n"; } sub get_elem_contents { my( $self, $node ) = @_; my $str = join '', map { $self->__wikify($_) } $node->content_list; return defined $str ? $str : ''; } sub get_wiki_page { my( $self, $uri ) = @_; my @wiki_uris = ref $self->wiki_uri eq 'ARRAY' ? @{$self->wiki_uri} : $self->wiki_uri; foreach my $wiki_uri ( @wiki_uris ) { my $page = $self->__extract_wiki_page( $uri, $wiki_uri ); return $page if $page; } return undef; } sub __extract_wiki_page { my( $self, $uri, $wiki_uri ) = @_; return undef unless $wiki_uri; if( ref $wiki_uri eq 'Regexp' ) { return $uri =~ $wiki_uri ? $1 : undef; } elsif( ref $wiki_uri eq 'CODE' ) { return $wiki_uri->( $self, URI->new($uri) ); } else { # Ensure $wiki_uri is absolute $wiki_uri = URI->new_abs( $wiki_uri, $self->base_uri )->as_string; return undef unless index( $uri, $wiki_uri ) == 0; return undef unless length $uri > length $wiki_uri; return substr( $uri, length $wiki_uri ); } } # Adapted from Kwiki source my $UPPER = '\p{UppercaseLetter}'; my $LOWER = '\p{LowercaseLetter}'; my $WIKIWORD = "$UPPER$LOWER\\p{Number}\\p{ConnectorPunctuation}"; sub is_camel_case { return $_[1] =~ /(?:[$UPPER](?=[$WIKIWORD]*[$UPPER])(?=[$WIKIWORD]*[$LOWER])[$WIKIWORD]+)/ } sub get_attr_str { my( $self, $node, @attrs ) = @_; my %attrs = map { $_ => $node->attr($_) } @attrs; my $str = join ' ', map { $_.'="'.encode_entities($attrs{$_}).'"' } grep { $attrs{$_} } @attrs; # (bug #19046) partial fix: attributes must be contained on a single line $str =~ s/[\n\r]/ /g if $str; return defined $str ? $str : ''; }
sub given_html { shift->_attr( { internal => 1 }, __given_html => @_ ) }
sub parsed_html { shift->_attr( { internal => 1 }, __parsed_html => @_ ) }
sub available_dialects { my @dialects; my %seen; for my $inc ( @INC ) { my $dir = File::Spec->catfile( $inc, 'HTML', 'WikiConverter' ); my $dh = DirHandle->new( $dir ) or next; while ( my $f = $dh->read ) { next unless $f =~ /^(\w+)\.pm$/; my $dialect = $1; next if $seen{$dialect}++; next if $dialect eq 'Normalizer' or $dialect eq 'WebApp'; push @dialects, $dialect; } } return wantarray ? sort @dialects : @dialects; }
sub rules_for_tag { my( $self, $tag ) = @_; my $rules = $self->__rules_for_tag($tag); return $rules->{alias} ? $self->__rules_for_tag( $rules->{alias} ) : $rules; } sub __rules_for_tag { my( $self, $tag ) = @_; return $self->__rules->{$tag} if $self->__rules->{$tag}; return $self->__rules->{UNKNOWN} if $self->__rules->{UNKNOWN} and !$isKnownTag{$tag}; return { }; }
sub __default_attribute_specs { { base_uri => { type => SCALAR, default => '' }, dialect => { type => SCALAR, optional => 0 }, encoding => { type => SCALAR, default => 'utf-8' }, escape_entities => { type => BOOLEAN, default => 1 }, normalize => { type => BOOLEAN, default => 1 }, p_strict => { type => BOOLEAN, default => 1 }, preprocess => { type => CODEREF | UNDEF, default => undef }, strip_empty_tags => { type => BOOLEAN, default => 0 }, slurp => { type => BOOLEAN, default => 0 }, strip_tags => { type => ARRAYREF, default => [ qw/ ~comment head script style / ] }, passthrough_naked_tags => { type => ARRAYREF | BOOLEAN, default => 0 }, user_agent => { type => OBJECT | UNDEF, default => undef }, wiki_uri => { type => SCALAR | ARRAYREF, default => '' }, wrap_in_html => { type => BOOLEAN, default => 1 }, } }
1;