Class RegexFilter

This filter accepts all string nodes matching a regular expression. Because this searches Text nodes. it is only useful for finding small fragments of text, where it is unlikely to be broken up by a tag. To find large fragments of text you should convert the page to plain text with something like the StringBean and then apply the regular expression.

For example, to look for dates use:

   (19|20)\d\d([- \\/.](0[1-9]|1[012])[- \\/.](0[1-9]|[12][0-9]|3[01]))?
 

as in:

 Parser parser = new Parser ("http://cbc.ca");
 RegexFilter filter = new RegexFilter ("(19|20)\\d\\d([- \\\\/.](0[1-9]|1[012])[- \\\\/.](0[1-9]|[12][0-9]|3[01]))?");
 NodeIterator iterator = parser.extractAllNodesThatMatch (filter).elements ();
 

which matches a date in yyyy-mm-dd format between 1900-01-01 and 2099-12-31, with a choice of five separators, either a dash, a space, either kind of slash or a period. The year is matched by (19|20)\d\d which uses alternation to allow the either 19 or 20 as the first two digits. The round brackets are mandatory. The month is matched by 0[1-9]|1[012], again enclosed by round brackets to keep the two options together. By using character classes, the first option matches a number between 01 and 09, and the second matches 10, 11 or 12. The last part of the regex consists of three options. The first matches the numbers 01 through 09, the second 10 through 29, and the third matches 30 or 31. The day and month are optional, but must occur together because of the ()? bracketing after the year.