On the use of data mining for estimating carbon storage in the trees
- Carlos Roberto Sanquetta†1,
- Jaime Wojciechowski†2,
- Ana Paula Dalla Corte†1Email author,
- Aurélio Lourenço Rodrigues†3 and
- Greyce Charllyne Benedet Maas†3
© Sanquetta et al.; licensee BioMed Central Ltd. 2013
Received: 15 February 2013
Accepted: 1 June 2013
Published: 10 June 2013
Forests contribute to climate change mitigation by storing carbon in tree biomass. The amount of carbon stored in this carbon pool is estimated by using either allometric equations or biomass expansion factors. Both of the methods provide estimate of the carbon stock based on the biometric parameters of a model tree. This study calls attention to the potential advantages of the data mining technique known as instance-based classification, which is not used currently for this purpose. The analysis of the data on the carbon storage in 30 trees of Brazilian pine (Araucaria angustifolia) shows that the instance-based classification provides as relevant estimates as the conventional methods do. The coefficient of correlation between the estimated and measured values of carbon storage in tree biomass does not vary significantly with the choice of the method. The use of some other measures of method performance leads to the same result. In contrast to the convention methods the instance-based classification does not presume any specific form of the function relating carbon storage to the biometric parameters of the tree. Since the best form of such function is difficult to find, the instance-based classification could outperform the conventional methods in some cases, or simply get rid of the questions about the choice of the allometric equations.
KeywordsBiomass Biomass expansion factor Euclidean distance Regression equations Root-to-shoot ratio
Forests play an important role in the global carbon balance, fixing carbon from the atmosphere, but can also become a source of emissions [1–3]. Therefore, their function is critical to global efforts to combat climate change. Quantifying carbon storage in forest ecosystems and the resulting changes stemming from human activities is a first step to better represent forests in climate policy at regional, national and global scales .
The estimates of biomass and carbon in forests can be made by direct and indirect methods [5–9]. Direct methods consist of weighing all biomass, which is typically a destructive process. This approach is not feasible for large-scale applications, due to time and implementation cost constraints. Meanwhile traditional indirect methods imply the use of some type of biomass and carbon modeling, using expansion factors and/or regression equations. However, such factors or equations need to be fitted using primary empirical data.
Regression equations whose dependent variable is individual tree carbon (C) and whose independent variables are tree measurement parameters, are often called allometric equations . In most instances they are appropriate because they offer direct estimates of C as functions of tree measurements, which are easy to measure and apply. However, they are not always satisfactory in terms of accuracy, and result in error levels beyond tolerance thresholds in forestry measurements.
The other traditional method consists of fitting bole volume (V) equations, which is commonly estimated in conventional forest inventories and usually obtained with high precision and accuracy, combined with factors that extrapolate the bole mass to estimate the entire aboveground as well as below ground biomass. These factors are called the Biomass Expansion Factor (BEF) and the Root-to-Shoot Ratio (R).
According to Soares & Tomé , allometric equations are recommended when estimating forest carbon, but if not available we can make use of expansion factors specific to different ages of forest stands. The limitations of biomass expansion factors are discussed by the authors.
Data mining aims to discover useful information in a data set . This technique, used in learning algorithms whose metrics can be found in  and Bradzil et al. , is now widespread in many areas and applications. However, its potential has not been exploited to estimate carbon stocks in forests. We decided to evaluate this technique because it allows one to better explore the nature of the numerical data, is simpler and more flexible than classical regression modeling because it did not require testing preconceived mathematical formulae, and also because it may yield estimates of individual tree carbon as accurate as those obtained from classical allometry.
This study aims to evaluate the technique of data mining against the two most common procedures for estimating carbon in forests. The species A. angustifolia, Brazil’s most important native conifer, was used as a case study.
Results and discussion
Descriptive statistics and correlation matrix
Descriptive statistics for the variables analyzed for A. angustifolia
Coefficient of Variation
Silveira  points out that studies on the use of BEF to estimate forest carbon are scarce in Brazil. The author has worked with a wide range of native species in dense rain forest in the state of Santa Catarina, Brazil. Watzlawick , Sanquetta et al.  and Schumacher et al. studied A. angustifolia biomass and carbon storage without evaluating BEF and R. In inferring biomass values presented by the authors, mean BEF and R values were 1.34 and 0.18 for stands aged 24–32 years in the the municipality of General Carneiro, Brazil . Mean BEF and R values of 1.32 and 0.15, respectively, were found for a 27-year-old stand that had been clearcut in the Quedas do Iguaçu municipality  and 1.39 for BEF in General Carneiro, in forest plantations with ages ranging from 14 to 32 years . In Pinus stands in the state of Paraná, Sanquetta et al. found average R and BEF values of 1.43 and 0.17, respectively, ranging from 0.05 to 0.63 for R and from 1.09 to 3.74 for BEF. Studies investigating biomass proportions in other species include that of Schneider and Finger  in Acacia mearnsii and Miranda et al. in Euterpe oleracea.
Simple correlation matrix for the variables DBH , H , Age, BEF , R and C for A. angustifolia
Ratuchne  studied several species in Araucaria Forest and found correlation coefficients of total individual biomass with tree measurement variables similar to this study, but lower than those presented here. The reason is that the author analyzed a wide range of species.
Statistical values of the fitted equations of total carbon for A. angustifolia
When the carbon stock estimates for individuals of the species were analyzed by using the best regression equation (Ĉ 1 ) and the respective real values of this variable, we found that the average difference was −1.22%, i.e., the average real value was 113.01 and the average estimated value was 111.63 kg (p = 0.7248). When comparing the estimates with Eq. 3 (Ĉ 2 ), which were based on combining the estimated volume (in this case the second model was used as it performed better) and the expansion factors (BEF and R) and the respective real values of C, an average difference of 5.28% was found, with average estimated value of 118.98 kg (p = 0.0859). Comparing the alternative method of data mining (Ĉ 3 ) resulted in a difference of 1.20%, with an estimated value of the variable of interest of 114.37 kg (p = 0.7556).
These differences, when analyzed by paired t test (p <0.05) were considered not significant, i.e., both estimates (Ĉ1,Ĉ 2 andĈ 3 ) were not statistically different from the actual value of C. Figure 4 illustrates the ratio of the actual values of C and its estimates by traditional methods (regression of the carbon equation and the volume equation combined with volume expansion factors) and the alternative method (data mining). The simple Pearson correlation’s coefficients of actual C and the three estimates were 0.9308; 0.9232, and 0.91455, respectively for Ĉ 1 , Ĉ 2 , for Ĉ 3 .
Obtaining the forest carbon stock is not feasible using direct methods. Therefore it is important to consider the relationships between tree dimensions that are easily obtained, such as diameter, height and age. There are several ways to estimate the carbon stocks in trees. The most traditional uses allometric equations and the applicatin of expansion factors . According to the authors, using allometric equations to estimate biomass is preferable, but when unavailable, expansion factors for different ages can be used. Sanquetta et al. found a clear dependent relationship between both BEF and R and age, revealing negative curvilinear trends for Pinus in the state of Paraná. Similar results were obtained for BEF by Soares & Tomé  in Eucalyptus globulus, although its meaning is somewhat different (total aerial biomass divided by the volume of the bole).
Due to their simplicity and immediate application, both BEF and R have been employed alternatively to estimate biomass and hence carbon. They represent a simple way to extrapolate from the carbon in the bole, which is generally more easily obtained and estimated by multiplying the volume by the density of the timber, to the living biomass of the entire tree. Typically BEF and R are assumed to be constant, which is not always the case. The IPCC (Intergovernmental Panel on Climate Change) itself publishes tables with default medium (default) for various forests of the world IPCC - Intergovernmental Panel on Climate Change , since research on BEF and R is lacking for most of the world's forests, especially in the tropics. The use of default values (average) could pose problems for estimates of biomass and carbon, but often the only values available, since in many cases allometric equations are not available.
In the present study the estimates by the two traditional methods closely approximated each other. This occurred because a clear dependent relationship between R and BEF and age could not be observed nor indeed between the tree measurement variables DBH and H, as opposed to the previously mentioned studies (Figure 4).
The arguments of Soares & Tomé  are relevant when considering tree stands of varying tree ages. However it is important to note that the greatest variations in BEF and R occur at younger ages, due to the faster growth rates and the differences in allocation of biomass to different plant tissues as the plant matures. On the other hand, in intermediate and older stands that whose growth rates have stabilized and assume some archetypal form, BEF and R often remain constant with advancing age (as seen in the aforementioned studies). In this case the supposed advantage of allometric equations does not manifest as in the case of our study, which showed no statistical difference between the two methods for estimating the carbon stock in A. angustifolia individuals.
It is important to note that estimates of volume are always more accurate than estimates of carbon. Therefore, potential advantages of the methods may emerge from future discussion of this work. If the variable carbon does not depend on age and size of the trees (DBH and H), statistical gains are possible using the second carbon estimation method presented here, which is also relatively straightforward. The influence of the wood density variable in this context warrants further exploration.
An alternative method, which has rarely been explored in forest science, is data mining. The technique consists of an information management tool used to facilitate the access and organization of knowledge structures that assist decision-making. In practice it amounts to exploratory data analysis and modeling. According to Cardoso and Machado , it represents one of the most effective alternatives to extracting information from large volumes of data, revealing hidden relationships, patterns and generating rules to predict and correlate data that can help institutions make decisions faster and with a higher degree of certainty. The technique has been used in the health sciences  and business Marcanoo Aular & Talavera Pereira  industries, among others, with some forestry applications such as the prediction of fires  and mapping forest cover . This technique allows one to better explore the nature of the data, is more flexible than the classical regression modeling because it requires testing preconceived mathematical formulations, and yields comparable and often more reliable estimates than classical allometry. Unfortunately there have been no studies applying the method to modeling forest carbon.
The results of this research indicate that the technique of data mining can be used to accurately estimate the carbon stock of A. angustifolia individuals. Its implementation is simple and yields estimates as satisfactory as those obtained by traditional methods of modeling carbon, such as equations fitted directly by linear regression or volume equations combined with expansion factors.
The use of data mining is shown as an initiative of the forest area to search techniques in other areas of knowledge that contribute in estimates of interest among researchers and foster the idea of diversifying methods in order to find better results, leaving the known techniques traditional and commonly used. Beyond data mining, other AI techniques have been studied with the same purpose. In Gorgens , Artificial Neural Networks were used to estimate tree volume and gave results compatible with traditional methods of fitting commonly used linear regression equations.
In other disciplines data mining has been used to classify dangerous parts of Brazilian cities, where useful information was found by employing decision trees for the attributes related to a particular characteristic such as infrastructure conditions, hydrology, soil, recreation area, community characteristics, among others. The goal of Malucelli et al.  was to classify parts of the city according to the degree of risk of residing in that area, indicating the potential for AI tools to be applied in any discipline including Forestry.
In contrast to the convention methods the instance-based classification does not presume any specific form of the function relating carbon storage to the biometric parameters of the tree. Since the best form of such function is difficult to find, the instance-based classification could outperform the conventional methods in some cases, or simply get rid of the questions about the choice of the allometric equations.
The data used in this study come from pure stands of Araucaria angustifolia Bert. O. Ktze. located in the municipalities of Foz do Iguaçu and General Carneiro, southern Paraná, Brazil. The forest stand of Iguaçu Falls is located between the geographical coordinates 25° 20’ 58” a 25° 34’ 55” South and 52° 36’ 24” e 53° 07’ 43” West, and was installed between 1987 and 1988. Meanwhile the forest stand in General Carneiro is located between the geographical coordinates 26° 20’ 35” a 26° 26’ 13” South and 51° 19’ 49” a 51° 25’ 29” West, and was installed between 1969 and 1987.
Thirty trees were used for this study and were felled and weighed directly. Wet weights of all biomass were determined in the field in separate compartments: bole without bark, bark, branches, foliage and roots. Data from DBH (diameter at breast height) and total height (H) of trees were also collected. Samples of biomass of each compartment 300 to 500 g were collected for laboratory analysis. Samples were collected between the years 2003 and 2004.
The fresh biomass samples were removed from the field and oven-dried to constant weight at a temperature of 70°C. Based on the relationship between wet weight and dry weight, the dry weights of all compartments of the biomass collected in the field were calculated. The samples were then chipped for analysis of carbon content (T) using the dry combustion method in an infrared chamber. Based on the carbon contents the carbon stocks in all compartments of the biomass were calculated, which together resulted in the total carbon (C) stock of the individual tree, the primary variable of this research.
Expansion factors and wood density
BEF = biomass expansion factor (dimensionless);
R = root ratio (dimensionless);
P canopy = dry weight of the tree canopy (kg);
P bole = dry weight of the tree bole (kg);
P aerial = dry weight of the tree bole + dry weight of the tree canopy (kg).
P roots = dry weight of the tree roots (kg).
Conceptually, the BEF is a factor used to extrapolate the weight of the tree bole to the whole biomass, considering the branches and foliage. It is usually used to calculate the entire aboveground biomass using only volume (usually estimated in conventional forest inventories) and the wood density. Meanwhile the Root Ratio (R) is a factor that expresses the ratio of the below ground biomass to the above ground biomass, and enables one to calculate the weight of the whole tree's biomass.
For the purposes of this study an average wood density was fixed at 0.425 g.cm-3 De Mattos et al. . This value, which expresses the relationship between weight and volume was used to calculate individual carbon stock based on bole volume and expansion factors (BEF and R), as will be discussed below.
Descriptive statistics and correlation analysis
We calculated descriptive statistics for the variables: DBH, H, Age (I), BEF, R and C and analyzed their correlations using a simple correlation matrix.
Methods for estimating carbon stock of individuals
Estimation of Carbon Stock of Individuals from Regression Equations
In this approach C was estimated directly from a regression equation fitted to the field data, i.e. C was estimated directly as a function of DBH and H (see Eqs. 4, 5, 6 and 7).
Estimation of Carbon Stock of Individuals from Bole Volume and Expansion Factors
Where: Y = individual carbon stock (C) in method 1 or total bole volume (V) in method 2; DBH = diameter at breast height, H = total height; βi = coefficients of the models.
One of the fitted equations was selected for comparative analyses. The following statistics were used as selection criteria: adjusted coefficient of determination (R2), standard error of the absolute estimate (Syx) and percentage (Syx%), as well as graphical analysis of residuals.
In this study we used a data mining technique known as Instance-Based Classification, which uses its own database instances to make estimates of new cases. The technique is based on the premise that certain instances, i.e. whose dimensions form vectors that approximate each other, tend to belong to the same class. This proximity can be measured as the distance between the vectors formed by the independent variables related to the object of study (in the case of this study, sampled trees with dimensions DBH, H and I).
p i and q i = measures of any two data points
DBH p = diameter of a tree bole p
DBH q = diameter of a tree bole q
H p = total height of tree p
H q = total height of tree q
I p = age of tree p
I q = age of tree q
The method uses a technique known as cross validation where each instance is compared to the others in the sample and the closest (shortest distance) instance is selected from among the rest. In this case the estimated carbon (C) of the individual for a given instance will be that value which is least distant.
According to Aha et al.  the occurrence of "noise" or instances that not well positioned, is common in this approach. This means that even if the dimensions of a particular instance fall within the range of the others, the value of the dependent variable may have very different values from those of the other instances. This instance is then called "noise" (which is different from an "outlier" or an atypical value and rejected from the data set). In the case of instances in this study, an example of "noise" would be a tree whose values of DBH, H, and Age are similar to other database instances, but whose C value differs significantly from the other instances. Problems then may arise when values of C of these “noise” instances are considered legitimate data values and would lie beyond the normal range, causing errors in the estimate. To minimize the vulnerability of relying on information from instances with these characteristics, a variation in the Instance-Based Classification technique was used. Thus, one can use one nearest neighbor (more susceptible to noise) or create a weighted measure using 3 (or more) nearest neighbors in order to dilute the error. In this case, we use the information from three (or more) nearest neighbors, but favor the closest since it is weighted by the inverse of the distance. This method was recommended in the study by Bradzil et al. , in which estimates using between one and five nearest neighbors were made.
The three variations of the method used in this study were:
in this case, C was estimated for the tree nearest the one in question;
three nearest neighbors with inverse distance weighting (1/d):
in this case, dimensions DBH and H of the three trees closest to the one in question were used to calculate the inverse Euclidean distance between them as weights in estimating C;
three nearest neighbors with inverse distance squared (1/d2) weighting:
analogous method to the previous, weighted by the inverse of the squared Euclidean distance.
To compare the three approaches to estimating the carbon stock of individuals, a paired t test (α = 0.05) was used, comparing the actual value of C with its estimates Ĉ 1 (regression) Ĉ 2 (Volume combined with BEF and R) and Ĉ 3 (data mining).
We would like to thank Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) of Brazil for financial support.
- Houghton RA: Aboveground forest biomass and the global carbon balance. Glob Chang Biol 2005, 11: 945–958. 10.1111/j.1365-2486.2005.00955.xView ArticleGoogle Scholar
- Broadmeadow M, Matthews R Forestry Commission. Information Note. Forests, carbon and climate change: the UK contribution 2003., 12:Google Scholar
- Sanquetta CR, Corte APD, Maas GCB: The role of forests in climate change. Quebracho 2011,19(2):84–96.Google Scholar
- Watson C: Forest carbon accounting: overview and principles. UNEP: UNDP; 2009:39.Google Scholar
- Brown S, Gillespie AJR, Lugo AE: Biomass estimation methods for tropical forests with applications to forest inventory data. Forest Sci 1989, 35: 881–902.Google Scholar
- Wharton EH, Griffith DM: Methods to estimate total forest biomass for extensive inventories. In applications in the northeastern U.S. U.S: USDA Forest Service Research Paper NE-681; 1993:161.Google Scholar
- Etienne M: Non-destructive methods for evaluating shrub biomass: a review. Acta Oecologica 1989, 10: 115–128.Google Scholar
- Sanquetta CR: Metodologias para determinação de biomassa florestal. In Gomes f dos s asflorestas e o carbono. Edited by: Sanquetta CR, Watzlawick LF, Balbinot R, Ziliotto MAB. Curitiba: UFPR; 2002:264.Google Scholar
- Cerrillo RMN, Oyonarte PB: Estimation of above-ground biomass in shrubland ecosystems of southern Spain. Invest Agrar: Sist Recur For 2006, 15: 197–207.Google Scholar
- Soares P, Tomé M: Analysis of the effectiveness of biomass expansion factors to estimate stand biomass. In Modeling forest production. proc. conf. vienna, 19–21 april (department of forest and soil sciences. Edited by: Hasenauer H, Makela A. Vienna: BOKU University of Natural Resources and Applied Life Sciences; 2004:368–374.Google Scholar
- Sanquetta CR, Corte APD, Silva F: Biomass expansion factor and root-to-shoot ratio for Pinus in Brazil. Carbon Balance and Management 2011,6(6):1–8.Google Scholar
- Tan P-N, Steinbach M, Kumar V: Introduction to data mining. Winter: Stanford University; 2009:108.Google Scholar
- Albert MK, Kibler D, Aha DW Machine learning. In Instance-based learning algorithms. Volume 6. University of California: Kluver Academic Publishers; 1991:37–66.Google Scholar
- Bradzil P, Soares CC, Joaquim P: Ranking learning algorithms: using IBL and a meta-learning on accuracy and time results. kluver academic publishers. university of Porto. Mach Learn 2003, 50: 251–277. 10.1023/A:1021713901879View ArticleGoogle Scholar
- Silveira P: Estimativa da biomassa e carbono acima do solo em um fragmento de floresta ombrófila densa utilizando o método da derivação do volume comercial. Floresta 2010,40(4):789–800.View ArticleGoogle Scholar
- Watzlawick LF: Tese (doutorado em engenharia florestal). Curitiba, PR: Universidade Federal do Paraná; 2003:120. Estimativa de biomassa e carbono em Floresta Ombrófila Mista e plantações florestais a partir de dados de imagens do satélite IKONOS II Estimativa de biomassa e carbono em Floresta Ombrófila Mista e plantações florestais a partir de dados de imagens do satélite IKONOS IIGoogle Scholar
- Sanquetta CR, Watzlawick LF, Schumacher MV, Mello AA: Relações individuais de biomassa e conteúdo de carbono em plantações de Araucaria angustifolia e Pinus taeda no sul do estado do Paraná Brasil. Acadêmica. Ciências Agrárias e Ambientais 2003,1(3):33–40.Google Scholar
- Schumacher MV, Finger CAG, Sobrinho VG, Schneider PSP: Produção de biomassa no corte raso em plantio de Araucaria angustifolia (Bertol.) Kuntze de 27 anos de idade em Quedas do Iguaçu, PR. Ciência Florestal 2011,21(1):53–62.Google Scholar
- Schneider PR, Finger CAG: Manejo sustentado de florestas inequiâneas heterogêneas. Santa Maria, RS: UFSM, Departamento de Ciências Florestais; 2000:195.Google Scholar
- Miranda DLC, Sanquetta CR, Costa LGS, Corte APD: Biomassa e carbono em Euterpe oleracea Mart., na Ilha do Marajó – PA. Floresta e Ambiente 2012,19(3):336–343. 10.4322/floram.2012.039View ArticleGoogle Scholar
- Ratuchne LC: Dissertação (mestrado em agronomia). Guarapuava, PR: Universidade Estadual do Centro-Oeste; 2010:111. Equações alométricas para estimativa de biomassa, carbono e nutrientes em uma Floresta Ombrófila Mista Equações alométricas para estimativa de biomassa, carbono e nutrientes em uma Floresta Ombrófila MistaGoogle Scholar
- De Oliveira MF, De Mattos PP, Braz EM, Rosot MAD, Rosot NC, Santos WC: Equação de volume para um plantio de Araucaria angustifolia em Rio Negro. In PR. Comunicado Técnico. Volume 275. Colombo: EMBRAPA; 2011:4.Google Scholar
- De Mattos PP, De Bortoli C, Marchesan R, Rosot NC Comunicado Técnico. In Caracterização física, química e anatômica da madeira de Araucaria angustifolia (Bert.). Volume 160. Edited by: O. Kuntze. Colombo: Embrapa; 2006:4.Google Scholar
- IPCC - Intergovernmental Panel on Climate Change Good Practice Guidance. Chapter 8. Emissions factor database 2013. . Accessed on: Jan. 11, 2013 http://www.ipcc.ch/ . Accessed on: Jan. 11, 2013Google Scholar
- Cardoso ONP, Machado RTM: Gestão do conhecimento usando data mining: estudo de caso na Universidade Federal de Lavras. Volume 42. Rio de Janeiro: Revista Administração Pública; 2008:3.Google Scholar
- Galvão ND, Marin HF: Técnica de mineração de dados: uma revisão da literatura. Acta Paulista de Enfermagem 2009, 22: 686–690. 10.1590/S0103-21002009000500014View ArticleGoogle Scholar
- Marcanoo Aular YJ, Talavera Pereira R: Minería de datos como soporte a la toma de decisiones empresariales. Opcion 2007,23(52):104–108.Google Scholar
- Cortez P, Morais A: A Data Mining Approach to Predict Forest Fires using Meteorological Data. In New Trends in Artificial Intelligence, Proceedings of the 13th EPIA 2007 - Portuguese Conference on Artificial Intelligence Decembe. Edited by: Neves J, Santos MF, Machado J. Guimarães, Portugal: ; 2007:512–523.Google Scholar
- Mithal VA, Garg S, Boriah M, Steinbach V, Kumar C, Potter SK, Castilla-Rubio JC: Monitoring global forest cover using data mining. ACM Transactions on Intelligent Systems and Technology 2011, 2: 24–36.View ArticleGoogle Scholar
- Gorgens E Dissertação. In Estimação do volume de árvores utilizando redes neurais artificiais. Volume 94. Viçosa: Universidade Federal de Viçosa; 2006.Google Scholar
- Malucelli A, Stein AVJ, Bastos L, Carvalho D, Cubas MR, Paraíso EC: Classificação de Microáreas de risco com uso de Mineração de Dados. Revista Saúde Pública, Pontifícia Universidade Católica do Paraná – PUCPR 2010,44(2):292–300.View ArticleGoogle Scholar
- IPCC - Intergovernmental Panel on Climate Change Good Practice Guidance. Guidelines for national greenhouse gas inventories 2006. . Acesso em: 11.01.2013 http://www.ipcc.ch/ . Acesso em: 11.01.2013Google Scholar
- Aha DW, Kibler D, Albert MK Machine Learning. In Instance-Based Learning Algorithms. Volume 6. Irvine, CA: Kluver Academic Publishers, Department of Information and Computer Science, University of California; 1991:37–66.Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.