REGEX(7) | Standards, Environments, and Macros | REGEX(7) |
regex
—
internationalized basic and extended regular expression
matching
Regular Expressions (REs) provide a mechanism to select specific strings from a set of character strings. The Internationalized Regular Expressions described below differ from the Simple Regular Expressions described on the regexp(7) manual page in the following ways:
The Basic Regular Expression (BRE) notation and construction rules described in the BASIC REGULAR EXPRESSIONS section apply to most utilities supporting regular expressions. Some utilities, instead, support the Extended Regular Expressions (ERE) described in the EXTENDED REGULAR EXPRESSIONS section; any exceptions for both cases are noted in the descriptions of the specific utilities using regular expressions. Both BREs and EREs are supported by the Regular Expression Matching interfaces regcomp(3C) and regexec(3C).
A BRE ordinary character, a special character preceded by a backslash, or a period matches a single character. A bracket expression matches a single character or a single collating element. See RE Bracket Expression, below.
An ordinary character is a BRE that matches itself: any character in the supported character set, except for the BRE special characters listed in BRE Special Characters, below.
The interpretation of an ordinary character preceded by a backslash ("\") is undefined, except for:
A BRE special character has special properties in certain contexts. Outside those contexts, or when preceded by a backslash, such a character will be a BRE that matches the special character itself. The BRE special characters and the contexts in which they have their special meaning are:
A period ("."), when used outside a bracket expression, is a BRE that matches any character in the supported character set except NUL.
A bracket expression (an expression enclosed in square brackets, "[]") is an RE that matches a single collating element contained in the non-empty set of collating elements represented by the bracket expression.
The following rules and definitions apply to bracket expressions:
The special characters ".", "*", "[", "\" (period, asterisk, left-bracket and backslash, respectively) lose their special meaning within a bracket expression.
The character sequences "[.", "[=", "[:" (left-bracket followed by a period, equals-sign, or colon) are special inside a bracket expression and are used to delimit collating symbols, equivalence class expressions, and character class expressions. These symbols must be followed by a valid expression and the matching terminating sequence ".]", "=]" or ":]", as described in the following items.
LC_CTYPE
category in the current locale. All character classes specified in the
current locale will be recognized. A character class expression is
expressed as a character class name enclosed within bracket-colon
("[::]") delimiters.
The following character class expressions are supported in all locales:
[:alnum:] | [:cntrl:] | [:lower:] | [:space:] |
[:alpha:] | [:digit:] | [:print:] | [:upper:] |
[:blank:] | [:graph:] | [:punct:] | [:xdigit:] |
In addition, character class expressions of the form
"[:name:]" are recognized in those locales where the
name keyword has
been given a
charclass
definition in the LC_CTYPE
category.
Range expressions must not be used in portable applications because their behavior is dependent on the collating sequence. Ranges will be treated according to the current collating sequence, and include such characters that fall within the range based on that collating sequence, regardless of character values. This, however, means that the interpretation will differ depending on collating sequence. If, for instance, one collating sequence defines as a variant of "a", while another defines it as a letter following "z", then the expression "[-z]" is valid in the first language and invalid in the second.
In the following, all examples assume the collation sequence specified for the POSIX locale, unless another collation sequence is specifically defined.
The starting range point and the ending range point must be a collating element or collating symbol. An equivalence class expression used as a starting or ending point of a range expression produces unspecified results. An equivalence class can be used portably within a bracket expression, but only outside the range. For example, the unspecified expression "[[=e=]-f]" should be given as "[[=e=]e-f]". The ending range point must collate equal to or higher than the starting range point; otherwise, the expression will be treated as invalid. The order used is the order in which the collating elements are specified in the current collation definition. One-to-many mappings (see locale(7)) will not be performed. For example, assuming that the character "eszet" is placed in the collation sequence after "r" and "s", but before "t", and that it maps to the sequence "ss" for collation purposes, then the expression "[r-s]" matches only "r" and "s", but the expression "[s-t]" matches "s", "beta", or "t".
The interpretation of range expressions where the ending range point is also the starting range point of a subsequent range expression (for instance "[a-m-o]") is undefined.
The hyphen character will be treated as itself if it occurs first (after an initial "^", if any) or last in the list, or as an ending range point in a range expression. As examples, the expressions "[-ac]" and "[ac-]" are equivalent and match any of the characters "a", "c", or "-;" "[^-ac]" and "[^ac-]" are equivalent and match any characters except "a", "c", or "-;" the expression "[%--]" matches any of the characters between "%" and "-" inclusive; the expression "[--@]" matches any of the characters between "-" and "@" inclusive; and the expression "[a--@]" is invalid, because the letter "a" follows the symbol "-" in the POSIX locale. To use a hyphen as the starting range point, it must either come first in the bracket expression or be specified as a collating symbol, for example: "[][.-.]-0]", which matches either a right bracket or any character or collating element that collates between hyphen and 0, inclusive.
If a bracket expression must specify both "-" and "]", the "]" must be placed first (after the "^", if any) and the "-" last within the bracket expression.
Note: Latin-1 characters such as "`" or "^" are not printable in some locales, for example, the ja locale.
The following rules can be used to construct BREs matching multiple characters from BREs matching a single character:
BRE_DUP_MAX
, where m specifies
the exact or minimum number of occurrences and n
specifies the maximum number of occurrences. The expression
"\{m\}" matches exactly m
occurrences of the preceding BRE, "\{m,\}"
matches at least m occurrences and
"\{m,n\}" matches any number
of occurrences between m and n,
inclusive.
For example, in the string "abababccccccd", the BRE "c\{3\}" is matched by characters seven to nine, the BRE "\(ab\)\{4,\}" is not matched at all and the BRE "c\{1,3\}d" is matched by characters ten to thirteen.
The behavior of multiple adjacent duplication symbols ("*" and intervals) produces undefined results.
The order of precedence is as shown in the following table:
BRE Precedence (from high to low) | |
collation-related bracket symbols | [= =] [: :] [. .] |
escaped characters | \<special character> |
bracket expression | [] |
subexpressions/back-references | \( \) \n |
single-character-BRE duplication | * \{m,n\} |
concatenation | |
anchoring | ^ $ |
A BRE can be limited to matching strings that begin or end a line; this is called anchoring. The circumflex and dollar sign special characters will be considered BRE anchors in the following contexts:
Note: The Solaris implementation does not support anchoring in BRE subexpressions.
The rules specified for BREs apply to Extended Regular Expressions (EREs) with the following exceptions:
An ERE ordinary character, a special character preceded by a backslash, or a period matches a single character. A bracket expression matches a single character or a single collating element. An ERE matching a single character enclosed in parentheses matches the same as the ERE without parentheses would have matched.
An ordinary character is an ERE that matches itself. An ordinary character is any character in the supported character set, except for the ERE special characters listed in ERE Special Characters below. The interpretation of an ordinary character preceded by a backslash ("\") is undefined.
An ERE special character has special properties in certain contexts. Outside those contexts, or when preceded by a backslash, such a character is an ERE that matches the special character itself. The extended regular expression special characters and the contexts in which they have their special meaning are:
A period ("."), when used outside a bracket expression, is an ERE that matches any character in the supported character set except NUL.
The rules for ERE Bracket Expressions are the same as for Basic Regular Expressions; see RE Bracket Expression, above.
The following rules will be used to construct EREs matching multiple characters from EREs matching a single character:
RE_DUP_MAX
, where m specifies
the exact or minimum number of occurrences and n
specifies the maximum number of occurrences. The expression
"{m}" matches exactly m
occurrences of the preceding ERE, "{m,}"
matches at least m occurrences and
"{m,n}" matches any number of occurrences
between m and n, inclusive.For example, in the string "abababccccccd" the ERE "c{3}" is matched by characters seven to nine and the ERE "(ab){2,}" is matched by characters one to six.
The behavior of multiple adjacent duplication symbols ("+", "*", "?" and intervals) produces undefined results.
Two EREs separated by the special character vertical-line ("|") match a string that is matched by either. For example, the ERE "a((bc)|d)" matches the string "abc" and the string "ad". Single characters, or expressions matching single characters, separated by the vertical bar and enclosed in parentheses, will be treated as an ERE matching a single character.
The order of precedence will be as shown in the following table:
ERE Precedence (from high to low) | |
collation-related bracket symbols | [= =] [: :] [. .] |
escaped characters | \<special character> |
bracket expression | [ ] |
grouping | ( ) |
single-character-ERE duplication | * + ? {m,n Ns} |
concatenation | |
anchoring | ^ $ |
alternation | | |
For example, the ERE "abba|cde" matches either the string "abba" or the string "cde" (rather than the string "abbade" or "abbcde", because concatenation has a higher order of precedence than alternation).
An ERE can be limited to matching strings that begin or end a line; this is called anchoring. The circumflex and dollar sign special characters are considered ERE anchors when used anywhere outside a bracket expression. This has the following effects:
localedef(1), regcomp(3C), attributes(7), environ(7), locale(7), regexp(7)
August 14, 2020 | OmniOS |