Circuit complexity

Example Boolean circuit. The nodes are AND gates, the nodes are OR gates, and the nodes are NOT gates

In theoretical computer science, circuit complexity is a branch of computational complexity theory in which Boolean functions are classified according to the size or depth of the Boolean circuits that compute them. A related notion is the circuit complexity of a recursive language that is decided by a uniform family of circuits (see below).

Proving lower bounds on size of Boolean circuits computing explicit Boolean functions is a popular approach to separating complexity classes. For example, a prominent circuit class P/poly consists of Boolean functions computable by circuits of polynomial size. Proving that would separate P and NP (see below).

Complexity classes defined in terms of Boolean circuits include AC0, AC, TC0, NC1, NC, and P/poly.

Size and depth

A Boolean circuit with input bits is a directed acyclic graph in which every node (usually called gates in this context) is either an input node of in-degree 0 labelled by one of the input bits, an AND gate, an OR gate, or a NOT gate. One of these gates is designated as the output gate. Such a circuit naturally computes a function of its inputs. The size of a circuit is the number of gates it contains and its depth is the maximal length of a path from an input gate to the output gate.

There are two major notions of circuit complexity[1] The circuit-size complexity of a Boolean function is the minimal size of any circuit computing . The circuit-depth complexity of a Boolean function is the minimal depth of any circuit computing .

These notions generalize when one considers the circuit complexity of any language that contains strings with different bit lengths, especially infinite formal languages. Boolean circuits, however, only allow a fixed number of input bits. Thus, no single Boolean circuit is capable of deciding such a language. To account for this possibility, one considers families of circuits where each accepts inputs of size . Each circuit family will naturally generate the language by circuit outputting when a length string is a member of the family, and otherwise. We say that a family of circuits is size minimal if there is no other family that decides on inputs of any size, , with a circuit of smaller size than (respectively for depth minimal families). Thus, circuit complexity is meaningful even for non-recursive languages. The notion of a uniform family enables variants of circuit complexity to be related to algorithm based complexity measures of recursive languages. However, the non-uniform variant is helpful to find lower bounds on how complex any circuit family must be in order to decide given languages.

Hence, the circuit-size complexity of a formal language is defined as the function , that relates a bit length of an input, , to the circuit-size complexity of a minimal circuit that decides whether inputs of that length are in . The circuit-depth complexity is defined similarly.

Uniformity

Boolean circuits are one of the prime examples of so-called non-uniform models of computation in the sense that inputs of different lengths are processed by different circuits, in contrast with uniform models such as Turing machines where the same computational device is used for all possible input lengths. An individual computational problem is thus associated with a particular family of Boolean circuits where each is the circuit handling inputs of n bits. A uniformity condition is often imposed on these families, requiring the existence of some possibly resource-bounded Turing machine that, on input n, produces a description of the individual circuit . When this Turing machine has a running time polynomial in n, the circuit family is said to be P-uniform. The stricter requirement of DLOGTIME-uniformity is of particular interest in the study of shallow-depth circuit-classes such as AC0 or TC0. When no resource bounds are specified, a language is recursive (i.e., decidable by a Turing machine) if and only if the language is decided by a uniform family of Boolean circuits.

Polynomial-time uniform

A family of Boolean circuits is polynomial-time uniform if there exists a deterministic Turing machine M, such that

  • M runs in polynomial time
  • For all , M outputs a description of on input

Logspace uniform

A family of Boolean circuits is logspace uniform if there exists a deterministic Turing machine M, such that

  • M runs in logarithmic work space (i.e. M is a log-space transducer)
  • For all , M outputs a description of on input

History

Circuit complexity goes back to Shannon in 1949,[2] who proved that almost all Boolean functions on n variables require circuits of size Θ(2n/n). Despite this fact, complexity theorists have so far been unable to prove a superlinear lower bound for any explicit function.

Superpolynomial lower bounds have been proved under certain restrictions on the family of circuits used. The first function for which superpolynomial circuit lower bounds were shown was the parity function, which computes the sum of its input bits modulo 2. The fact that parity is not contained in AC0 was first established independently by Ajtai in 1983[3][4] and by Furst, Saxe and Sipser in 1984.[5] Later improvements by Håstad in 1987[6] established that any family of constant-depth circuits computing the parity function requires exponential size. Extending a result of Razborov,[7] Smolensky in 1987[8] proved that this is true even if the circuit is augmented with gates computing the sum of its input bits modulo some odd prime p.

The k-clique problem is to decide whether a given graph on n vertices has a clique of size k. For any particular choice of the constants n and k, the graph can be encoded in binary using bits, which indicate for each possible edge whether it is present. Then the k-clique problem is formalized as a function such that outputs 1 if and only if the graph encoded by the string contains a clique of size k. This family of functions is monotone and can be computed by a family of circuits, but it has been shown that it cannot be computed by a polynomial-size family of monotone circuits (that is, circuits with AND and OR gates but without negation). The original result of Razborov in 1985[7] was later improved to an exponential-size lower bound by Alon and Boppana in 1987.[9] In 2008, Rossman[10] showed that constant-depth circuits with AND, OR, and NOT gates require size to solve the k-clique problem even in the average case. Moreover, there is a circuit of size that computes .

In 1999, Raz and McKenzie later showed that the monotone NC hierarchy is infinite.[11]

The Integer Division Problem lies in uniform TC0.[12]

Circuit lower bounds

Circuit lower bounds are generally difficult. Known results include

  • Parity is not in nonuniform AC0, proved by Ajtai in 1983[3][4] as well as by Furst, Saxe and Sipser in 1984.[5]
  • Uniform TC0 is strictly contained in PP, proved by Allender.[13]
  • The classes SP
    2
    , PP[nb 1] and MA/1[14] (MA with one bit of advice) are not in SIZE(nk) for any constant k.
  • While it is suspected that the nonuniform class ACC0 does not contain the majority function, it was only in 2010 that Williams proved that .[15]

It is open whether NEXPTIME has nonuniform TC0 circuits.

Proofs of circuit lower bounds are strongly connected to derandomization. A proof that would imply that either or that permanent cannot be computed by nonuniform arithmetic circuits (polynomials) of polynomial size and polynomial degree.[16]

In 1997, Razborov and Rudich showed that many known circuit lower bounds for explicit Boolean functions imply the existence of so called natural properties useful against the respective circuit class.[17] On the other hand, natural properties useful against P/poly would break strong pseudorandom generators. This is often interpreted as a "natural proofs" barrier for proving strong circuit lower bounds. In 2016, Carmosino, Impagliazzo, Kabanets and Kolokolova proved that natural properties can be also used to construct efficient learning algorithms.[18]

Complexity classes

Many circuit complexity classes are defined in terms of class hierarchies. For each non-negative integer i, there is a class NCi, consisting of polynomial-size circuits of depth , using bounded fan-in AND, OR, and NOT gates. The union NC of all of these classes is a subject to discussion. By considering unbounded fan-in gates, the classes ACi and AC (which is equal to NC) can be constructed. Many other circuit complexity classes with the same size and depth restrictions can be constructed by allowing different sets of gates.

Relation to time complexity

If a certain language, , belongs to the time-complexity class for some function , then has circuit complexity . If the Turing Machine that accepts the language is oblivious (meaning that it reads and writes the same memory cells regardless of input), then has circuit complexity .[19]

Monotone circuits

A monotone Boolean circuit is one that has only AND and OR gates, but no NOT gates. A monotone circuit can only compute a monotone Boolean function, which is a function where for every , , where means that for all .

See also

Notes

  1. ^ See proof.

References

  1. ^ Sipser, Michael (1997). Introduction to the theory of computation (1 ed.). Boston, USA: PWS Publishing Company. p. 324.
  2. ^ Shannon, Claude Elwood (1949). "The synthesis of two-terminal switching circuits". Bell System Technical Journal. 28 (1): 59–98. doi:10.1002/j.1538-7305.1949.tb03624.x.
  3. ^ a b Ajtai, Miklós (1983). "-formulae on finite structures". Annals of Pure and Applied Logic. 24: 1–24. doi:10.1016/0168-0072(83)90038-6.
  4. ^ a b Ajtai, Miklós; Komlós, János; Szemerédi, Endre (1983). "An sorting network". Proceedings of the 15th Annual ACM Symposium on Theory of Computing, 25–27 April, 1983, Boston, Massachusetts, USA. Association for Computing Machinery. pp. 1–9. doi:10.1145/800061.808726.
  5. ^ a b Furst, Merrick L.; Saxe, James Benjamin; Sipser, Michael Fredric (1984). "Parity, circuits, and the polynomial-time hierarchy". Mathematical Systems Theory. 17 (1): 13–27. doi:10.1007/BF01744431. MR 0738749. S2CID 6306235.
  6. ^ Håstad, Johan Torkel (1987). Computational limitations of small depth circuits (PDF) (Ph.D. thesis). Massachusetts Institute of Technology.
  7. ^ a b Razborov, Aleksandr Aleksandrovich (1985). "Lower bounds on the monotone complexity of some Boolean functions". Soviet Mathematics - Doklady. 31: 354–357. ISSN 0197-6788.
  8. ^ Smolensky, Roman (1987). "Algebraic methods in the theory of lower bounds for Boolean circuit complexity". Proceedings of the 19th Annual ACM Symposium on Theory of Computing. Association for Computing Machinery. pp. 77–82. doi:10.1145/28395.28404.
  9. ^ Alon, Noga; Boppana, Ravi B. (1987). "The monotone circuit complexity of Boolean functions". Combinatorica. 7 (1): 1–22. CiteSeerX 10.1.1.300.9623. doi:10.1007/bf02579196. S2CID 17397273.
  10. ^ Rossman, Benjamin E. (2008). "On the constant-depth complexity of k-clique". STOC 2008: Proceedings of the 40th annual ACM symposium on Theory of computing. Association for Computing Machinery. pp. 721–730. doi:10.1145/1374376.1374480.
  11. ^ Raz, Ran; McKenzie, Pierre (1999). "Separation of the monotone NC hierarchy". Combinatorica. 19 (3): 403–435. doi:10.1007/s004930050062.
  12. ^ Hesse, William (2001). "Division is in uniform TC0". Proceedings of the 28th International Colloquium on Automata, Languages and Programming. Springer Verlag. pp. 104–114.
  13. ^ Allender, Eric (1996). "Circuit complexity before the dawn of the new millennium". In Chandru, Vijay; Vinay, V. (eds.). Foundations of Software Technology and Theoretical Computer Science, 16th Conference, Hyderabad, India, December 18–20, 1996, Proceedings. Lecture Notes in Computer Science. Vol. 1180. Springer. pp. 1–18. doi:10.1007/3-540-62034-6_33.
  14. ^ Santhanam, Rahul (2007). "Circuit lower bounds for Merlin-Arthur classes". STOC 2007: Proceedings of the thirty-ninth annual ACM symposium on Theory of computing. pp. 275–283. CiteSeerX 10.1.1.92.4422. doi:10.1145/1250790.1250832.
  15. ^ Williams, Richard Ryan (2011). "Non-Uniform ACC Circuit Lower Bounds" (PDF). CCC 2011: Proceedings of the 26th Annual IEEE Conference on Computational Complexity. pp. 115–125. doi:10.1109/CCC.2011.36.
  16. ^ Kabanets, Valentine; Impagliazzo, Russell Graham (2004). "Derandomizing polynomial identity tests means proving circuit lower bounds". Computational Complexity. 13 (1): 1–46. doi:10.1007/s00037-004-0182-6. S2CID 12451799.
  17. ^ Razborov, Aleksandr Aleksandrovich; Rudich, Steven (1997). "Natural proofs". Journal of Computer and System Sciences. Vol. 55. pp. 24–35.
  18. ^ Carmosino, Marco; Impagliazzo, Russell Graham; Kabanets, Valentine; Kolokolova, Antonina (2016). "Learning algorithms from natural proofs". Computational Complexity Conference.
  19. ^ Pippenger, Nicholas; Fischer, Michael J. (1979). "Relations Among Complexity Measures". Journal of the ACM. 26 (3): 361–381. doi:10.1145/322123.322138. S2CID 2432526.

Further reading

Read other articles:

BullheadPoster TeatrikalIndex cardSutradaraMichaël R. RoskamProtagonis Matthias Schoenaerts Jeroen Perceval Barbara Sarafian Performing arts productionSavage FilmNaskahMichael R. Roskam MusikRaf KeunenPenyuntingan filmAlain Dessauvage DistributorKinepolis Film DistributionDrafthouse FilmsPenampilan perdana 02 Februari 2011 (2011-02-02) Durasi128 menitBahasa asli (film atau acara televisi)Belanda Prancis Lokasi pemfilmanLiège Warnaberwarna Pendapatan box office$151,840 (US)DeskripsiGenrefi…

Widespread leakage into Canadian residential buildings due to poor waterproofing Low-rise residential building undergoing repairs to correct apparent leaky condo syndrome in Vancouver's West Point Grey neighborhood, 2014. The leaky condo crisis, also known as the leaky condo syndrome and rotten condo crisis, is an ongoing construction, financial, and legal crisis in Canada. It primarily involves multi-unit condominium (or strata) buildings damaged by rainwater infiltration in the Lower Mainland …

County in Michigan, United States County in MichiganCass CountyCountyCass County Courthouse in Cassopolis SealLocation within the U.S. state of MichiganMichigan's location within the U.S.Coordinates: 41°55′N 85°59′W / 41.91°N 85.99°W / 41.91; -85.99Country United StatesState MichiganFounded1829[1]Named forLewis CassSeatCassopolisLargest cityDowagiacArea • Total508 sq mi (1,320 km2) • Land490 sq mi …

National demographics Demographics of GrenadaPopulation pyramid of Grenada in 2020Population113,949 (2022 est.)Growth rate0.32% (2022 est.)Birth rate13.94 births/1,000 population (2022 est.)Death rate8.31 deaths/1,000 population (2022 est.)Life expectancy75.74 years • male73.13 years • female78.6 yearsFertility rate1.93 children born/woman (2022 est.)Infant mortality rate9.4 deaths/1,000 live birthsNet migration rate-2.43 migrant(s)/1,000 population (2022 est.)Age st…

British biochemist (1936–2021) SirDai ReesFRSBornDavid Allan Rees(1936-04-28)28 April 1936[2]Silloth, Cumberland, EnglandDied10 June 2021(2021-06-10) (aged 85)[3]Alma materUniversity College of North Wales, Bangor (BSc, PhD)Spouse Myfanwy Margaret Parry Owen ​ ​(m. 1959)​[2]Awards Colworth Medal (1970)[1] FRS (1981) Scientific careerFieldsBiochemistryInstitutions University of Edinburgh National Institute for Medical …

City of Udham Singh Nagar district in the Indian state of Uttarakhand City in Uttarakhand, IndiaKashipurCityMaharana Pratap Chowk, Main crossroad of KashipurKashipurLocation within India and UttarakhandShow map of UttarakhandKashipurKashipur (India)Show map of IndiaCoordinates: 29°13′N 78°57′E / 29.22°N 78.95°E / 29.22; 78.95Country IndiaStateUttarakhandDistrictUdham Singh NagarFounded1639[1]Municipality1872Founded byKashinath Adhikari, an officer of …

Pour les articles homonymes, voir Hogues. Pont Camille-de-Hogues Pont Camille-de-Hogues vu de l'amont Géographie Pays France Région Nouvelle-Aquitaine Département Vienne Commune Châtellerault Coordonnées géographiques 46° 48′ 49″ N, 0° 32′ 15″ E Fonction Franchit Vienne Fonction pont routier Caractéristiques techniques Type Pont en béton armé Longueur 140 m Largeur 8 m Matériau(x) Béton armé Construction Construction 1899-1900 Concept…

Portuguese novelist (1922–2010) In this Portuguese name, the first or maternal family name is Sousa and the second or paternal family name is Saramago. José SaramagoGColSE GColCaSaramago in January 2008BornJosé de Sousa Saramago(1922-11-16)16 November 1922Azinhaga, Santarém, PortugalDied18 June 2010(2010-06-18) (aged 87)Tías, Canary Islands, SpainOccupationWriterNationalityPortuguesePeriod1947–2010Notable works Baltasar and Blimunda (1982) The Year of the Death of Ricardo Reis (…

1924 film by Monta Bell The SnobLobby cardDirected byMonta BellWritten byMonta BellBased onThe Snob: The Story of a Marriageby Helen Reimensnyder MartinStarringJohn GilbertNorma ShearerConrad NagelCinematographyAndré BarlatierEdited byRalph LawsonDistributed byMetro-Goldwyn-MayerRelease date November 19, 1924 (1924-11-19) (United States) Running time70 minutesCountryUnited StatesLanguageSilent (English intertitles)Budget$100,000[1] The Snob is a 1924 American silent d…

谢赫·穆吉布·拉赫曼Sheikh Mujibur Rahmanশেখ মুজিবুর রহমান第1任孟加拉總統任期1971年4月11日—1972年1月12日总理塔杰丁·艾哈迈德前任首任继任Nazrul Islam (Acting)任期1975年1月25日—1975年8月15日总理Muhammad Mansur Ali前任Mohammad Mohammadullah继任孔达卡尔·穆什塔克·艾哈迈德第2任孟加拉總理任期1972年1月12日—1972年1月24日总统阿布·赛义德·乔杜里Mohammad Mohammadullah前任Tajuddin…

Universitas DoshishaKapel di Kampus ImadegawaMotoVeritas liberabit vos(Kebenaran akan membebaskanmu)Jenisperguruan tinggi swastaDidirikanDidirikan 1875,sebagai universitas: 1920PresidenEiji HattaWakil PresidenNobuhiro Tabata, Yasuhiro Kuroki, Tsutao Katayama, Takashi NishimuraStaf akademik401 profesor, 125 associate professor; 1.212 assistant professor[1]Sarjana23.514[1]Magister2.774[1]LokasiKyoto, Prefektur Kyoto, Jepang35°01′47″N 135°45′39″E / …

Stasiun Kami-Horonobe (上幌延駅 Kami-Horonobe-eki) adalah sebuah stasiun kereta api yang berada di Jalur Utama Sōya di Horonobe, Distrik Teshio, Hokkaido, Jepang, yang dioperasikan oleh JR Hokkaido. Stasiun ini diberi nomor W71. Stasiun Kami-Horonobe上幌延駅Bangunan Stasiun Kami-HoronobeLokasiKami-Horonobe, Horonobe, Distrik Teshio, Prefektur Hokkaido 098-3225, JepangJepangKoordinat44°59′9″N 141°52′52″E / 44.98583°N 141.88111°E / 44.98583; 141.88111Ko…

 本表是動態列表,或許永遠不會完結。歡迎您參考可靠來源來查漏補缺。 潛伏於中華民國國軍中的中共間諜列表收錄根據公開資料來源,曾潛伏於中華民國國軍、被中國共產黨聲稱或承認,或者遭中華民國政府調查審判,為中華人民共和國和中國人民解放軍進行間諜行為的人物。以下列表以現今可查知時間為準,正確的間諜活動或洩漏機密時間可能早於或晚於以下所歸類…

American comic book character Comics character VigilanteGreg Saunders as he appeared on the cover of Leading Comics #5 (December 1942).Art by Mort Meskin.Publication informationPublisherDC ComicsFirst appearanceAction Comics #42 (November 1941)Created by Mort Weisinger Mort Meskin In-story informationAlter egoGreg SaundersTeam affiliations Seven Soldiers of Victory All-Star Squadron Justice League PartnershipsShining KnightAbilities Brilliant marksman Superb hand-to-hand combatant Master of the …

XM8 beralih ke halaman ini. Untuk the satellite radio station, lihat '80s on 8. Untuk the American tank, lihat M8 Armored Gun System. XM8 An early version of the XM8 Jenis Senapan serbu Senapan otomatis Senapan mesin ringan Senapan runduk/Senapan penembak jitu PDW Negara asal Jerman Amerika Serikat Sejarah pemakaian Masa penggunaan 2010–sekarang Digunakan oleh Angkatan Laut Malaysia Sejarah produksi Tahun 2002 Produsen Heckler & Koch Alliant Technosystems Diproduksi 2003–s…

Elephant conversation programme of the Indian governmentProject ElephantLogo of Project ElephantElephant conservation overviewFormed1992Parent departmentMinistry of Environment, Forest and Climate Change, Government of IndiaWebsitehttps://moef.gov.in/ Wildlife of India Biodiversity Fauna Flora Lists Amphibians Ants Birds Butterflies Endangered animals Fish Mammals Molluscs Moths Odonates Reptiles Spiders Tiger beetles Protected areas Biosphere reserves Communal forests Conservation areas Conserv…

NaskahPapirus P {\displaystyle {\mathfrak {P}}} 5NamaP. Oxy. 208 + 1781TeksInjil Yohanes1; 16; 20 †Waktu~250Aksarabahasa YunaniDitemukanOxyrhynchus, MesirKini diBritish LibraryKutipanGrenfell & Hunt, Oxyrhynchus Papyri II, 1899, pp. 1 ff; XV, pp. 8-12.Ukuran12,5 cm kali 25 cmJenisTeks WesternKategoriITangantangan dokumentariCatatandekat dengan Codex Sinaiticus Papirus 5 (bahasa Inggris: Papyrus 5; dalam penomoran Gregory-Aland), diberi kode siglum P {\displaystyle {\math…

Ancient population during the Iron Age Rock Drawings in Valcamonica: Camunian rose and two human figures (one in martellina, the other in graffiti) The Camuni or Camunni were an ancient population located in Val Camonica during the Iron Age (1st millennium BC); the Latin name Camunni was attributed to them by the authors of the 1st century. They are also called ancient Camuni, to distinguish them from the current inhabitants of the valley (the Camuni or Camunians). The Camunni were among the gre…

American computer scientist (born 1981) Scott AaronsonAaronson in 2011BornScott Joel Aaronson (1981-05-21) May 21, 1981 (age 43)Philadelphia, Pennsylvania, United StatesNationalityAmericanAlma mater Cornell University University of California, Berkeley Known for Quantum Turing machine with postselection Algebrization Boson sampling SpouseDana MoshkovitzAwards Alan T. Waterman Award PECASE Tomassoni–Chisesi Prize ACM Prize in Computing Scientific careerFieldsComputational complex…

Alcuni dei contenuti riportati potrebbero generare situazioni di pericolo o danni. Le informazioni hanno solo fine illustrativo, non esortativo né didattico. L'uso di Wikipedia è a proprio rischio: leggi le avvertenze. Disambiguazione – Se stai cercando altri significati, vedi Polvere da sparo (disambigua). Questa voce o sezione sull'argomento esplosivi non cita le fonti necessarie o quelle presenti sono insufficienti. Commento: Bibliografia di ben scarsa utilità. Puoi migliorare quest…