Jump to content

Post-normal science

From Wikipedia, the free encyclopedia

Post-normal science diagram
Jerome Ravetz and Silvio Funtowicz, circa 1988, at Sheffield

Post-normal science (PNS) was developed in the 1990s by Silvio Funtowicz and Jerome R. Ravetz.[1][2][3] It is a problem-solving strategy appropriate when "facts [are] uncertain, values in dispute, stakes high and decisions urgent", conditions often present in policy-relevant research. In those situations, PNS recommends suspending temporarily the traditional scientific ideal of truth, concentrating on quality as assessed by internal and extended peer communities.[1][4]

PNS can be considered as complementing the styles of analysis based on risk and cost-benefit analysis prevailing at that time and integrating concepts of a new critical science developed in previous works by the same authors.[5][6]

PNS is not a new scientific method following Aristotle and Bacon, a new paradigm in the Kuhnian sense, or an attempt to reach a new ‘normal’. It is instead, a set of insights to guide actionable and robust knowledge production for policy decision making and action in challenges like pandemics, ecosystems collapse, biodiversity loss and, in general, sustainability transitions.[7][8]

Context

[edit]

According to its proponents[3] Silvio Funtowicz and Jerome R. Ravetz, the name "post-normal science" echoes the seminal work on modern science by Thomas Kuhn.[9] For Carrozza[10] PNS can be "framed in terms of a call for the ‘democratization of expertise’", and as a "reaction against long-term trends of ‘scientization’ of politics—the tendency towards assigning to experts a critical role in policymaking while marginalizing laypeople". For Mike Hulme (2007), writing on The Guardian, climate change seems to fall into the category of issues which are best dealt with in the context of PNS and notes that “Disputes in post-normal science focus as often on the process of science - who gets funded, who evaluates quality, who has the ear of policy - as on the facts of science”.[11] Climate science as PNS was already proposed by the late Stephen Schneider,[12] and a similar linkage was propose for the workings of the Intergovernmental Panel on Climate Change.[13]

From the ecological perspective post-normal science can be situated in the context of 'crisis disciplines' – a term coined by the conservation biologist Michael E. Soulé to indicate approaches addressing fears, emerging in the seventies, that the world was on the verge of ecological collapse. In this respect Michael Egan[14] defines PNS as a 'survival science'. More recently PNS has been defined as a movement of ‘informed critical resistance, reform and the making of futures’.[15]

Moving from PNS Ziauddin Sardar developed the concept of Postnormal Times (PNT). Sardar was the editor of FUTURES when it published the article ‘Science for the post-normal age’[3] presently the most cited paper of the journal. A recent review of academic literature conducted on the Web of Science and encompassing the topics of Futures studies, Foresight, Forecasting and Anticipation Practice[16] identifies the same paper as "the all-time publication that received the highest number of citations".

Content

[edit]

"At birth Post-normal science was conceived as an inclusive set of robust insights more than as an exclusive fully structured theory or field of practice".[17] Some of the ideas underpinning PNS can already be found in a work published in 1983 and entitled "Three types of risk assessment: a methodological analysis" [18] This and subsequent works [1][2][3][5] show that PNS concentrates on few aspects of the complex relation between science and policy: the communication of uncertainty, the assessment of quality, and the justification and practice of the extended peer communities.

Coming to the PNS diagram (figure above) the horizontal axis represents ‘Systems Uncertainties’ and the vertical one ‘Decision Stakes’. The three quadrants identify Applied Science, Professional Consultancy, and Post-Normal Science. Different standards of quality and styles of analysis are appropriate to different regions in the diagram, i.e. post-normal science does not claim relevance and cogency on all of science's application but only on those defined by the PNS's mantram with a fourfold challenge: ‘facts uncertain, values in dispute, stakes high and decisions urgent’. For applied research science's own peer quality control system will suffice (or so was assumed at the moment PNS was formulated in the early nineties), while professional consultancy was considered appropriate for these settings which cannot be ‘peer-reviewed’, and where the skills and the tacit knowledge of a practitioner are needed at the forefront, e.g. in a surgery room, or in a house on fire. Here a surgeon or a firefighter takes a difficult technical decision based on her or his training and appreciation of the situation (the Greek concept of ‘Metis’ as discussed by J. C. Scott.[19])

Complexity

[edit]

There are important linkages between PNS and complexity science,[20] e.g. system ecology (C. S. Holling) and hierarchy theory (Arthur Koestler). In PNS, complexity is respected through its recognition of a multiplicity of legitimate perspectives on any issue; this is close to the meaning espoused by Robert Rosen (theoretical biologist).[21] Reflexivity is realised through the extension of accepted ‘facts’ beyond the supposedly objective productions of traditional research. Also, the new participants in the process are not treated as passive learners at the feet of the experts, being coercively convinced through scientific demonstration. Rather, they will form an ‘extended peer community’, sharing the work of quality assurance of the scientific inputs to the process, and arriving at a resolution of issues through debate and dialogue.[22] The necessity to embrace complexity in a post-normal perspective to understand and face zoonoses is argumented by David Waltner-Toews.[23]

Extended peer community

[edit]

In PNS extended peer communities are spaces where perspectives, values, styles of knowing and power differentials are expressed in a context of inequalities and conflict. Resolutions, compromises and knowledge co-production are contingent and not necessarily achievable.[1][4][24][25]

Applications

[edit]

Beside its dominating influence in the literature on 'futures',[16] PNS is considered to have influenced the ecological ‘conservation versus preservation debate’, especially via its reading by American pragmatist Bryan G. Norton. According to Jozef Keulartz [26] the PNS concept of "extended peer community" influenced how Norton's developed his 'convergence hypothesis'. The hypothesis posits that ecologists of different orientation will converge once they start thinking 'as a mountain', or as a planet. For Norton this will be achieved via deliberative democracy, which will pragmatically overcome the black and white divide between conservationists and preservationists. More recently it has been argued that conservation science, embedded as it is in a multi-layered governance structures of policy-makers, practitioners, and stakeholders, is itself an 'extended peer community', and as a result conservation has always been ‘post-normal’.[27]

Other authors attribute to PNS the role of having stimulated the take up of transdisciplinary methodological frameworks, reliant on the social constructivist perspective embedded in PNS.[28][8]

Post-normal science is intended as applicable to most instances where the use of evidence is contested due to different norms and values. Typical instances are in the use of evidence based policy[29] and in evaluation.[30]

As summarized in a recent work "the ideas and concepts of post normal science bring about the emergence of new problem solving strategies in which the role of science is appreciated in its full context of the complexity and the uncertainty of natural systems and the relevance of human commitments and values."[31]

For Peter Gluckman (2014), chief science advisor to the Prime Minister of New Zealand, post-normal science approaches are today appropriate for a host of problems including "eradication of exogenous pests […], offshore oil prospecting, legalization of recreational psychotropic drugs, water quality, family violence, obesity, teenage morbidity and suicide, the ageing population, the prioritization of early-childhood education, reduction of agricultural greenhouse gases, and balancing economic growth and environmental sustainability".[32]

Conservation science is also a field where PNS is suggested as to fill the space between research, policy, and implementation,[33][34] as well as to ensure pluralism in analysis.[35][36] Ecosystem services are a topical subject for PNS.[37][38]

Reviews of the history and evolution of PNS, its definitions, conceptualizations, and uses can be found in Turnpenny et al., 2010,[39] and in The Routledge Handbook of Ecological Economics (Nature and Society).[8] Articles on PNS are published in Nature[32][40][41][42][43][44] and related journals.[45][46]

Criticism

[edit]

A criticism of post-normal science is offered by Weingart (1997)[47] for whom post-normal science does not introduce a new epistemology but retraces earlier debates linked to the so-called "finalization thesis". For Jörg Friedrichs [48] – comparing the issues of climate change and peak energy – an extension of the peer community has taken place in the climate science community, transforming climate scientists into ‘stealth advocates’,[49] while scientists working on energy security – without PNS, would still maintain their credentials of neutrality and objectivity. Another criticism is that the extended peer community's use undermines the scientific method's use of empiricism and that its goal would be better addressed by providing greater science education.

The crisis of science

[edit]

It has been argued [50] that post-normal science scholars have been prescient in anticipating the present crisis in science's quality control and reproducibility. A group of scholars of post-normal science orientation has published in 2016 a volume on the topic,[51] discussing inter alia what this community perceive as the root causes of the present science's crisis.[52][50][53][54]

Quantitative approaches

[edit]

Among the quantitative styles of analysis which make reference to post-normal science one can mention NUSAP for numerical information, sensitivity auditing for indicators and mathematical modelling, Quantitative storytelling for exploring multiple frames in a quantitative analysis, and MUSIASEM in the field of social metabolism. A work where these approaches are suggested for sustainability is in.[55]

Mathematical modelling

[edit]

In relation to mathematical modelling post-normal science suggests a participatory approach, whereby ‘models to predict and control the future’ are replaced by ‘models to map our ignorance about the future’, in the process exploring and revealing the metaphors embedded in the model.[56] PNS is also known for its definition of garbage in, garbage out (GIGO): in modelling GIGO occurs when the uncertainties in the inputs must be suppressed, lest the outputs become completely indeterminate.[57]

COVID-19

[edit]

On 25 March 2020, in the midst of the COVID-19 pandemic, a group of scholars of post-normal orientation published on the blog section of the STEPS Centre (for Social, Technological and Environmental Pathways to Sustainability) at the University of Sussex. The piece[58] argues that the COVID-19 emergency has all the elements of a post-normal science context, and notes that "this pandemic offers society an occasion to open a fresh discussion on whether we now need to learn how to do science in a different way".

Special issues

[edit]

The journal FUTURES devoted several specials issues to post-normal science.

  • The third special issue on post-normal science was in 2017.[60] This special issue contains a selection of papers discussed at the University of Bergen's Centre for the Study of the Sciences and the Humanities between 2014 and 2016. The issue includes also two extended commentaries on the present crisis in science and the post-fact/post-truth discourse, one from Europe[50] and one from Japan.[61]

Another special issue on post-normal science was published on the journal Science, Technology, & Human Values in May 2011.

References

[edit]
  1. ^ a b c d Funtowicz, S. O. and Ravetz, J. R., 1991. "A New Scientific Methodology for Global Environmental Issues", in Costanza, R. (ed.), Ecological Economics: The Science and Management of Sustainability: 137–152. New York: Columbia University Press.
  2. ^ a b Funtowicz, S. O.; Ravetz, J. R. (1992). "Three types of risk assessment and the emergence of postnormal science". In Krimsky, Sheldon; Golding, Dominic (eds.). Social Theories of Risk. Bloomsbury Academic. pp. 251–273. ISBN 978-0-275-94168-0.
  3. ^ a b c d Funtowicz, Silvio O.; Ravetz, Jerome R. (September 1993). "Science for the post-normal age". Futures. 25 (7): 739–755. doi:10.1016/0016-3287(93)90022-L.
  4. ^ a b EJOLT. (2023). EJAtlas | Mapping Environmental Justice. Environmental Justice Atlas. https://ejatlas.org/
  5. ^ a b Funtowicz, S. and Ravetz, J., 1990. Uncertainty and Quality in Science for Policy. Dordrecht: Kluwer Academic Publishers.[page needed]
  6. ^ Ravetz, J. R., 1971. Scientific Knowledge and its Social Problems. Oxford University Press.[page needed]
  7. ^ Funtowicz, S. and Ravetz, J., "Post-normal science", in Companion to Environmental Studies, Edited ByNoel Castree, Mike Hulme, James D. Proctor, 2018, Routledge.
  8. ^ a b c Strand, Roger (2017). "Post-Normal Science". In Spash, Clive L. (ed.). Routledge Handbook of Ecological Economics. Routledge. pp. 288–297. doi:10.4324/9781315679747. ISBN 978-1-315-67974-7.
  9. ^ T. Kuhn, The Structure of Scientific Revolutions. University of Chicago Press, 1962.[page needed]
  10. ^ Carrozza, Chiara (January 2015). "Democratizing Expertise and Environmental Governance: Different Approaches to the Politics of Science and their Relevance for Policy Analysis". Journal of Environmental Policy & Planning. 17 (1): 108–126. Bibcode:2015JEPP...17..108C. doi:10.1080/1523908X.2014.914894.
  11. ^ Hulme, Mike (14 March 2007). "The appliance of science". The Guardian.
  12. ^ Schneider, S., Post Normal Science, retrieved 11 July 2024
  13. ^ Saloranta, T. M. (1 September 2001). "Post-Normal Science and the Global Climate Change Issue". Climatic Change. 50 (4): 395–404. Bibcode:2001ClCh...50..395S. doi:10.1023/A:1010636822581. ISSN 1573-1480.
  14. ^ Egan, Michael (February 2017). "Survival Science: Crisis Disciplines and the Shock of the Environment in the 1970s1: Survival science". Centaurus. 59 (1–2): 26–39. doi:10.1111/1600-0498.12149.
  15. ^ J. R. Ravetz, "Post-Normal Science Symposium: Address by Jerome Ravetz Reflections on ‘informed critical resistance, reform and the making of futures,’" University of Oxford, Institute for Science, Innovation and Society, 2018. [Online]. Available: https://www.insis.ox.ac.uk/article/post-normal-science-symposium-address-jerome-ravetz
  16. ^ a b Thomas Gauthier, Sylvaine Mercuri Chapuis, 2018, An Investigation of Futures Studies Scholarly Literature, In: Poli R. (eds) Handbook of Anticipation. Springer, Cham
  17. ^ Funtowicz, S., 2016, personal correspondence.
  18. ^ Funtowicz, S. O. and Ravetz, J. R. (1985), Three types of risk assessment: a methodological analysis, in C. Whipple and V. T. Covello (Eds), Risk Analysis in the Private Sector, pp 217-232 (Plenum, New York).
  19. ^ Scott, James C. (2020). Seeing Like a State. doi:10.12987/9780300252989. ISBN 978-0-300-25298-9.[page needed]
  20. ^ Rees, M., 2017, Black holes are simpler than forests and science has its limits, AEON, 1 December.
  21. ^ Rosen, Robert (January 1977). "Complexity as a System Property". International Journal of General Systems. 3 (4): 227–232. doi:10.1080/03081077708934768.
  22. ^ Funtowicz, Silvio O; Ravetz, Jerome R (November 1997). "The poetry of thermodynamics". Futures. 29 (9): 791–810. doi:10.1016/S0016-3287(97)00059-1.
  23. ^ Waltner-Toews, David (19 July 2017). "Zoonoses, One Health and complexity: wicked problems and constructive conflict". Philosophical Transactions of the Royal Society B: Biological Sciences. 372 (1725): 20160171. doi:10.1098/rstb.2016.0171. PMC 5468696. PMID 28584179.
  24. ^ Martínez Alier, Joan (2 July 2020). "A global environmental justice movement: mapping ecological distribution conflicts". Disjuntiva. Crítica de les Ciències Socials. 1 (2): 83. doi:10.14198/DISJUNTIVA2020.1.2.6. hdl:10045/107812.
  25. ^ Féaux de la Croix, Jeanne (2023). "Collaboration". Oxford Research Encyclopedia of Anthropology. doi:10.1093/acrefore/9780190854584.013.174. ISBN 978-0-19-085458-4.
  26. ^ Keulartz, Jozef (2018). "Does Deliberation Promote Ecological Citizenship? The Convergence Hypothesis and the Reality of Polarization". A Sustainable Philosophy—The Work of Bryan Norton. The International Library of Environmental, Agricultural and Food Ethics. Vol. 26. pp. 189–212. doi:10.1007/978-3-319-92597-4_12. ISBN 978-3-319-92596-7.
  27. ^ Rose, David Christian (2018). "Avoiding a Post-truth World: Embracing Post-normal Conservation". Conservation and Society. 16 (4): 518–524. doi:10.4103/cs.cs_17_131. JSTOR 26500664. Gale A556008584 ProQuest 2113043321.
  28. ^ Heaslip, Eimear; Fahy, Frances (November 2018). "Developing transdisciplinary approaches to community energy transitions: An island case study". Energy Research & Social Science. 45: 153–163. Bibcode:2018ERSS...45..153H. doi:10.1016/j.erss.2018.07.013.
  29. ^ Saltelli, Andrea; Giampietro, Mario (August 2017). "What is wrong with evidence based policy, and how can it be improved?". Futures. 91: 62–71. arXiv:1607.07398. doi:10.1016/j.futures.2016.11.012.
  30. ^ Schwandt, Thomas A. (July 2019). "Post-normal evaluation?". Evaluation. 25 (3): 317–329. doi:10.1177/1356389019855501.
  31. ^ Lister, Andee Rose (2018). The bioaccumulation of uranium in sheep heart and kidney: the impact of contaminated traditional food sources on the Navajo Reservation (Thesis).
  32. ^ a b Gluckman, Peter (March 2014). "Policy: The art of science advice to government". Nature. 507 (7491): 163–165. doi:10.1038/507163a. PMID 24627919.
  33. ^ Rose, D. C. (2018). "Avoiding a Post-truth World: Embracing Post-normal Conservation". Conservation and Society. 16 (4). [Ashoka Trust for Research in Ecology and the Environment, Wolters Kluwer India Pvt. Ltd.]: 518–524. doi:10.4103/cs.cs_17_131. ISSN 0972-4923.
  34. ^ Buschke, F. T., Botts, E. A., Sinclair, S. P. (2019). "Post-normal conservation science fills the space between research, policy, and implementation". Conservation Science and Practice. 1 (8): e73. Bibcode:2019ConSP...1E..73B. doi:10.1111/csp2.73. ISSN 2578-4854.
  35. ^ Francis, R. A., Goodman, M. K. (1 May 2010). "Post-normal science and the art of nature conservation". Journal for Nature Conservation. 18 (2): 89–105. Bibcode:2010JNatC..18...89F. doi:10.1016/j.jnc.2009.04.002. ISSN 1617-1381.
  36. ^ Lévesque, A., Bissonnette, J.-F., Vansintjan, A., Dupras, J. (2024). "Conflicting perspectives on ecosystem conservation in a cultivated floodplain: The role of science and the challenge of pluralism in decision-making in Lac Saint-Pierre (Quebec, Canada)". Environmental Policy and Governance. 34 (5): 476–489. doi:10.1002/eet.2095. ISSN 1756-9338.
  37. ^ Ainscough, J., Wilson, M., Kenter, J. O. (1 June 2018). "Ecosystem services as a post-normal field of science". Ecosystem Services. 31: 93–101. Bibcode:2018EcoSv..31...93A. doi:10.1016/j.ecoser.2018.03.021. ISSN 2212-0416.
  38. ^ Kay, J. J., Regier, H. A., Boyle, M., Francis, G. (1 September 1999). "An ecosystem approach for sustainability: addressing the challenge of complexity". Futures. 31 (7): 721–742. doi:10.1016/S0016-3287(99)00029-4. ISSN 0016-3287.
  39. ^ Turnpenny, John; Jones, Mavis; Lorenzoni, Irene (May 2011). "Where Now for Post-Normal Science?: A Critical Review of its Development, Definitions, and Uses". Science, Technology, & Human Values. 36 (3): 287–306. doi:10.1177/0162243910385789.
  40. ^ Grinnell, Frederick (June 2015). "Rethink our approach to assessing risk". Nature. 522 (7556): 257. Bibcode:2015Natur.522..257G. doi:10.1038/522257a. PMID 26085235.
  41. ^ "Future present". Nature. 531 (7592): 7–8. March 2016. Bibcode:2016Natur.531R...7.. doi:10.1038/531007b. PMID 26935658.
  42. ^ Dietl, Gregory P. (January 2016). "Different worlds". Nature. 529 (7584): 29–30. doi:10.1038/nature16329. PMID 26675725.
  43. ^ Ravetz, Jerry (21 November 2019). "Stop the science training that demands 'don't ask'". Nature. 575 (7783): 417. Bibcode:2019Natur.575..417R. doi:10.1038/d41586-019-03527-y. PMID 31745366. Gale A642124287.
  44. ^ Büntgen, Ulf (8 May 2024). "The importance of distinguishing climate science from climate activism". npj Climate Action. 3 (1): 36. Bibcode:2024npjCA...3...36B. doi:10.1038/s44168-024-00126-0.
  45. ^ Saltelli, Andrea (27 August 2019). "A short comment on statistical versus mathematical modelling". Nature Communications. 10 (1): 3870. Bibcode:2019NatCo..10.3870S. doi:10.1038/s41467-019-11865-8. PMC 6712000. PMID 31455789.
  46. ^ Norström, Albert V.; Cvitanovic, Christopher; Löf, Marie F.; West, Simon; Wyborn, Carina; Balvanera, Patricia; Bednarek, Angela T.; Bennett, Elena M.; Biggs, Reinette; de Bremond, Ariane; Campbell, Bruce M.; Canadell, Josep G.; Carpenter, Stephen R.; Folke, Carl; Fulton, Elizabeth A.; Gaffney, Owen; Gelcich, Stefan; Jouffray, Jean-Baptiste; Leach, Melissa; Le Tissier, Martin; Martín-López, Berta; Louder, Elena; Loutre, Marie-France; Meadow, Alison M.; Nagendra, Harini; Payne, Davnah; Peterson, Garry D.; Reyers, Belinda; Scholes, Robert; Speranza, Chinwe Ifejika; Spierenburg, Marja; Stafford-Smith, Mark; Tengö, Maria; van der Hel, Sandra; van Putten, Ingrid; Österblom, Henrik (March 2020). "Principles for knowledge co-production in sustainability research". Nature Sustainability. 3 (3): 182–190. Bibcode:2020NatSu...3..182N. doi:10.1038/s41893-019-0448-2. hdl:1874/410045.
  47. ^ Weingart, Peter (December 1997). "From 'Finalization' to 'Mode 2': old wine in new bottles?". Social Science Information. 36 (4): 591–613. doi:10.1177/053901897036004002.
  48. ^ Friedrichs, Jörg (May 2011). "Peak energy and climate change: The double bind of post-normal science". Futures. 43 (4): 469–477. doi:10.1016/j.futures.2010.12.004.
  49. ^ Pielke, Jr, Roger A. (2007). The Honest Broker. doi:10.1017/CBO9780511818110. ISBN 978-0-521-87320-8.[page needed]
  50. ^ a b c Saltelli, Andrea; Funtowicz, Silvio (August 2017). "What is science's crisis really about?". Futures. 91: 5–11. doi:10.1016/j.futures.2017.05.010.
  51. ^ Benessia, A., Funtowicz, S., Giampietro, M., Guimarães Pereira, A., Ravetz, J., Saltelli, A., Strand, R., van der Sluijs, J., 2016. The Rightful Place of Science: Science on the Verge. The Consortium for Science, Policy and Outcomes at Arizona State University.
  52. ^ Ravetz, J., 2016, How should we treat science's growing pains? The Guardian, 8 June 2016.
  53. ^ Andrea, Saltelli (December 2018). "Why science's crisis should not become a political battling ground". Futures. 104: 85–90. doi:10.1016/j.futures.2018.07.006. hdl:10609/93175.
  54. ^ Ravetz, Jerry (19 November 2019). "Stop the science training that demands 'don't ask'". Nature. 575 (7783): 417. Bibcode:2019Natur.575..417R. doi:10.1038/d41586-019-03527-y. PMID 31745366.
  55. ^ Saltelli, Andrea; Benini, Lorenzo; Funtowicz, Silvio; Giampietro, Mario; Kaiser, Matthias; Reinert, Erik; van der Sluijs, Jeroen P. (April 2020). "The technique is never neutral. How methodological choices condition the generation of narratives for sustainability". Environmental Science & Policy. 106: 87–98. Bibcode:2020ESPol.106...87S. doi:10.1016/j.envsci.2020.01.008. hdl:1956/21941.
  56. ^ Ravetz, Jerry (2003). "Models as metaphors". In Kasemir, Bernd; Jäger, Jill; Jaeger, Carlo C.; Gardner, Matthew T. (eds.). Public Participation in Sustainability Science: A Handbook. Cambridge University Press. pp. 62–77. ISBN 978-0-521-52144-4.
  57. ^ Funtowicz, Silvio; Ravetz, Jerry (October 1990). "Post-normal science: A new science for new times". Scientific European. pp. 20–22.
  58. ^ "Post-normal pandemics: Why COVID-19 requires a new approach to science". STEPS Centre. 25 March 2020.
  59. ^ Davies, M.W., Editor, 2011, Special Issue: Postnormal Times Futures, Volume 43, Issue 2, Pages 135-228 (March 2011). http://www.sciencedirect.com/science/journal/00163287/43/2
  60. ^ Dankel, Dorothy J.; Vaage, Nora S.; van der Sluijs, Jeroen P. (August 2017). "Post-normal science in practice". Futures. 91: 1–4. doi:10.1016/j.futures.2017.05.009.
  61. ^ Tsukahara, Togo (1 August 2017). "Commentary: New Currents in Science: The Challenge of Quality, examining the discrepancies and incongruities between Japanese techno-scientific policy and the citizens' science movement in post-3/11 Japan". Futures. 91: 84–89. doi:10.1016/j.futures.2017.04.008. hdl:20.500.14094/90005640.

Bibliography

[edit]
[edit]