Backus–Naur form

In computer science, Backus–Naur form (BNF, pronounced ), also known as Backus normal form, is a notation system for defining the syntax of programming languages and other formal languages, developed by John Backus and Peter Naur. It is a metasyntax for context-free grammars, providing a precise way to outline the rules of a language's structure.

It has been widely used in official specifications, manuals, and textbooks on programming language theory, as well as to describe document formats, instruction sets, and communication protocols. Over time, variations such as extended Backus–Naur form (EBNF) and augmented Backus–Naur form (ABNF) have emerged, building on the original framework with added features.

Structure

BNF specifications outline how symbols are combined to form syntactically valid sequences. Each BNF consists of three core components: a set of non-terminal symbols, a set of terminal symbols, and a series of derivation rules. Non-terminal symbols represent categories or variables that can be replaced, while terminal symbols are the fixed, literal elements (such as keywords or punctuation) that appear in the final sequence. Derivation rules provide the instructions for replacing non-terminal symbols with specific combinations of symbols.

A derivation rule is written in the format:
::= __expression__

where:

* <symbol> is a non-terminal symbol, enclosed in angle brackets (<>), identifying the category to be replaced
* is a metasymbol meaning "is replaced by,"
* __expression__ is the replacement, consisting of one or more sequences of symbols—either terminal symbols (e.g., literal text like "Sr." or ",") or non-terminal symbols (e.g., )—with options separated by a vertical bar (, ) to indicate alternatives.
For example, in the rule , the entire line is the derivation rule, "Sr.", "Jr.", and "" (an empty string) are terminal symbols, and is a non-terminal symbol.

Generating a valid sequence involves starting with a designated start symbol and iteratively applying the derivation rules. This process can extend sequences incrementally. To allow flexibility, some BNF definitions include an optional "delete" symbol (represented as an empty alternative, e.g., ), enabling the removal of certain elements while maintaining syntactic validity.

Example

A practical illustration of BNF is a specification for a simplified U.S. postal address:
::=

::= ,

::= , "."

::=

::= ","

::= "Sr." , "Jr." , , ""
::= "Apt" , ""
This translates into English as:
* A postal address consists of a name-part, followed by a street-address part, followed by a zip-code part.
* A name-part consists of either: a personal-part followed by a last name followed by an optional suffix (Jr. Sr., or dynastic number) and end-of-line, or a personal part followed by a name part (this rule illustrates the use of recursion in BNFs, covering the case of people who use multiple first and middle names and initials).
* A personal-part consists of either a first name or an initial followed by a dot.
* A street address consists of a house number, followed by a street name, followed by an optional apartment specifier, followed by an end-of-line.
* A zip-part consists of a town-name, followed by a comma, followed by a state code, followed by a ZIP-code followed by an end-of-line.
* An opt-suffix-part consists of a suffix, such as "Sr.", "Jr." or a roman-numeral, or an empty string (i.e. nothing).
* An opt-apt-num consists of a prefix "Apt" followed by an apartment number, or an empty string (i.e. nothing).

Note that many things (such as the format of a first-name, apartment number, ZIP-code, and Roman numeral) are left unspecified here. If necessary, they may be described using additional BNF rules.

History

The concept of using rewriting rules to describe language structure traces back to at least Pāṇini, an ancient Indian Sanskrit grammarian who lived sometime between the 6th and 4th centuries BC. His notation for describing Sanskrit word structure is equivalent in power to that of BNF and exhibits many similar properties.

In Western society, grammar was long regarded as a subject for teaching rather than scientific study; descriptions were informal and targeted at practical usage. This perspective shifted in the first half of the 20th century, when linguists such as Leonard Bloomfield and Zellig Harris began attempts to formalize language description, including phrase structure. Meanwhile, mathematicians explored related ideas through string rewriting rules as formal logical systems, such as Axel Thue in 1914, Emil Post in the 1920s–40s, and Alan Turing in 1936. Noam Chomsky, teaching linguistics to students of information theory at MIT combined linguistics and mathematics, adapting Thue's formalism to describe natural language syntax. In 1956, he introduced a clear distinction between generative rules (those of context-free grammars) and transformation rules.

BNF itself emerged when John Backus, a programming language designer at IBM, proposed a metalanguage of ''metalinguistic formulas'' to define the syntax of the new programming language IAL, known today as ALGOL 58, in 1959. This notation was formalized in the ALGOL 60 report, where Peter Naur named it ''Backus normal form'' in the committee's 1963 report.Revised ALGOL 60 report section 1.1. Whether Backus was directly influenced by Chomsky's work is uncertain.

Donald Knuth argued in 1964 that BNF should be read as ''Backus–Naur form'', as it is "not a normal form in the conventional sense," unlike Chomsky normal form. In 1967, Peter Zilahy Ingerman suggested renaming it ''Pāṇini Backus form'' to acknowledge Pāṇini's earlier, independent development of a similar notation.

In the ALGOL 60 report, Naur described BNF as a ''metalinguistic formula'':Revised ALGOL 60 report section. 1.1.

This is exemplified in the report's section 2.3, where comments are specified:

For the purpose of including text among the symbols of a program the following "comment" conventions hold:

Equivalence here means that any of the three structures shown in the left column may be replaced, in any occurrence outside of strings, by the symbol shown in the same line in the right column without any effect on the action of the program.

Naur altered Backus's original symbols for ALGOL 60, changing :≡ to ::= and the overbarred "" to , , using commonly available characters.

BNF is very similar to canonical-form Boolean algebra equations (used in logic-circuit design), reflecting Backus's mathematical background as a FORTRAN designer. Studies of Boolean algebra were commonly part of a mathematics curriculum, which may have informed Backus's approach. Neither Backus nor Naur described the names enclosed in < > as non-terminals—Chomsky's terminology was not originally used in describing BNF. Naur later called them "classes" in 1961 course materials. In the ALGOL 60 report, they were "metalinguistic variables," with other symbols defining the target language.

Saul Rosen, involved with the Association for Computing Machinery since 1947, contributed to the transition from IAL to ALGOL and edited Communications of the ACM. He described BNF as a metalanguage for ALGOL in his 1967 book. Early ALGOL manuals from IBM, Honeywell, Burroughs, and Digital Equipment Corporation followed this usage.

Impact

BNF significantly influenced programming language development, notably as the basis for early compiler-compiler systems. Examples include Edgar T. Irons' "A Syntax Directed Compiler for ALGOL 60" and Brooker and Morris' "A Compiler Building System," which directly utilized BNF. Others, like Schorre's META II, adapted BNF into a programming language, replacing < > with quoted strings and adding operators like $ for repetition, as in: EXPR = TERM $('+' TERM .OUT('ADD') , '-' TERM .OUT('SUB')); This influenced tools like yacc, a widely used parser generator rooted in BNF principles, and Unix utilities like yacc. BNF remains one of the oldest computer-related notations still referenced today, though its variants often dominate modern applications.

Examples of its use as a metalanguage include defining arithmetic expressions: ::= , Here, can recursively include itself, allowing repeated additions.
BNF today is one of the oldest computer-related languages still in use.

BNF representation of itself

BNF's syntax itself may be represented with a BNF like the following:

::= ,
::= "<" ">" "::="
::= " " , ""
::= , ", "
::= ,
::= ,
::= , "<" ">"
::= '"' '"' , "'" "'"
::= "" ,
::= "" ,
::= , ,
::= "A" , "B" , "C" , "D" , "E" , "F" , "G" , "H" , "I" , "J" , "K" , "L" , "M" , "N" , "O" , "P" , "Q" , "R" , "S" , "T" , "U" , "V" , "W" , "X" , "Y" , "Z" , "a" , "b" , "c" , "d" , "e" , "f" , "g" , "h" , "i" , "j" , "k" , "l" , "m" , "n" , "o" , "p" , "q" , "r" , "s" , "t" , "u" , "v" , "w" , "x" , "y" , "z"
::= "0" , "1" , "2" , "3" , "4" , "5" , "6" , "7" , "8" , "9"
::= ", " , " " , "!" , "#" , "$" , "%" , "&" , "(" , ")" , "*" , "+" , "," , "-" , "." , "/" , ":" , ";" , ">" , "=" , "<" , "?" , "@" , " "\" , " , "^" , "_" , "`" , "" , "~"
::= , "'"
::= , '"'
::= ,
::= , , "-"

Note that "" is the empty string.

The original BNF did not use quotes as shown in <literal> rule. This assumes that no whitespace is necessary for proper interpretation of the rule.

<EOL> represents the appropriate line-end specifier (in ASCII, carriage-return, line-feed or both depending on the operating system). <rule-name> and <text> are to be substituted with a declared rule's name/label or literal text, respectively.

In the U.S. postal address example above, the entire block-quote is a <syntax>. Each line or unbroken grouping of lines is a rule; for example one rule begins with <name-part> ::=. The other part of that rule (aside from a line-end) is an expression, which consists of two lists separated by a vertical bar , . These two lists consists of some terms (three terms and two terms, respectively). Each term in this particular rule is a rule-name.

Variants

EBNF

There are many variants and extensions of BNF, generally either for the sake of simplicity and succinctness, or to adapt it to a specific application. One common feature of many variants is the use of regular expression repetition operators such as * and +. The extended Backus–Naur form (EBNF) is a common one.

Another common extension is the use of square brackets around optional items. Although not present in the original ALGOL 60 report (instead introduced a few years later in IBM's PL/I definition), the notation is now universally recognised.

ABNF

Augmented Backus–Naur form (ABNF) and Routing Backus–Naur form (RBNF) are extensions commonly used to describe Internet Engineering Task Force (IETF) protocols.

Parsing expression grammars build on the BNF and regular expression notations to form an alternative class of formal grammar, which is essentially analytic rather than generative in character.

Others

Many BNF specifications found online today are intended to be human-readable and are non-formal. These often include many of the following syntax rules and extensions:
* Optional items enclosed in square brackets: lt;item-x>/code>.
* Items existing 0 or more times are enclosed in curly brackets or suffixed with an asterisk (*) such as <word> ::= <letter> or <word> ::= <letter> <letter>* respectively.
* Items existing 1 or more times are suffixed with an addition (plus) symbol, +, such as <word> ::= <letter>+.
* Terminals may appear in bold rather than italics, and non-terminals in plain text rather than angle brackets.
* Where items are grouped, they are enclosed in simple parentheses.

Software using BNF or variants

Software that accepts BNF (or a superset) as input

* ANTLR, a parser generator written in Java
* Coco/R, compiler generator accepting an attributed grammar in EBNF
* DMS Software Reengineering Toolkit, program analysis and transformation system for arbitrary languages
* GOLD, a BNF parser generator
* RPA BNF parser. Online (PHP) demo parsing: JavaScript, XML
* XACT X4MR System, a rule-based expert system for programming language translation
* XPL Analyzer, a tool which accepts simplified BNF for a language and produces a parser for that language in XPL; it may be integrated into the supplied SKELETON program, with which the language may be debugged (a SHARE contributed program, which was preceded by ''A Compiler Generator'')
* bnfparser², a universal syntax verification utility
* bnf2xml, Markup input with XML tags using advanced BNF matching
* JavaCC, Java Compiler Compiler tm (JavaCC tm) - The Java Parser Generator

Similar software

* GNU bison, GNU version of yacc
*Yacc, parser generator (most commonly used with the Lex preprocessor)
* Racket's parser tools, lex and yacc-style parsing (Beautiful Racket edition)
* Qlik Sense, a BI tool, uses a variant of BNF for scripting
* BNF Converter (BNFC), operating on a variant called "labeled Backus–Naur form" (LBNF). In this variant, each production for a given non-terminal is given a label, which can be used as a constructor of an algebraic data type representing that nonterminal. The converter is capable of producing types and parsers for abstract syntax in several languages, including Haskell and Java

See also

* Augmented Backus–Naur form (ABNF)
* Compiler Description Language (CDL)
* Definite clause grammar – a more expressive alternative to BNF used in Prolog
* Extended Backus–Naur form (EBNF)
* Meta-II – an early compiler writing tool and notation
* Syntax diagram – railroad diagram
* Translational Backus–Naur form (TBNF)
* Van Wijngaarden grammar – used in preference to BNF to define Algol68
* Wirth syntax notation – an alternative to BNF from 1977

References

External links

* .
* — Augmented BNF for Syntax Specifications: ABNF.
* — Routing BNF: A Syntax Used in Various Protocol Specifications.
* ISO/IEC 14977:1996(E) ''Information technology – Syntactic metalanguage – Extended BNF'', available from or from (the latter is missing the cover page, but is otherwise much cleaner)

Language grammars

* , the original BNF.
* , freely available BNF grammars for SQL.
* , freely available BNF grammars for SQL, Ada, Java.
* , freely available BNF/ EBNF grammars for C/C++, Pascal, COBOL, Ada 95, PL/I.
* . Includes parts 11, 14, and 21 of the ISO 10303 (STEP) standard.

{{DEFAULTSORT:Backus-Naur Form
Formal languages
Compiler construction
Metalanguages