ISO 12233-2014.pdf

ISO 2014Photography Electronic still picture imaging Resolution and spatial frequency responsesPhotographie Imagerie des prises de vues lectroniques Rsolution et rponses en frquence spatialeINTERNATIONAL STANDARDISO12233Second edition2014-02-15Reference numberISO 12233:2014(E)Copyright International Organization for Standardization Provided by IHS under license with ISO Licensee=University of Alberta/5966844001,User=sharabiani,shahramfsNot for Resale,02/25/2014 21:26:02 MSTNo reproduction or networking permitted without license from IHS-,-,-ISO 12233:2014(E)ii ISO 2014 All rights reservedCOPYRIGHT PROTECTED DOCUMENT ISO 2014All rights reserved.Unless otherwise specified,no part of this publication may be reproduced or utilized otherwise in any form or by any means,electronic or mechanical,including photocopying,or posting on the internet or an intranet,without prior written permission.Permission can be requested from either ISO at the address below or ISOs member body in the country of the requester.ISO copyright officeCase postale 56 CH-1211 Geneva 20Tel.[phone]Fax[phone]E-mail copyrightiso.orgWeb www.iso.orgPublished in SwitzerlandCopyright International Organization for Standardization Provided by IHS under license with ISO Licensee=University of Alberta/5966844001,User=sharabiani,shahramfsNot for Resale,02/25/2014 21:26:02 MSTNo reproduction or networking permitted without license from IHS-,-,-ISO 12233:2014(E)ISO 2014 All rights reserved iiiContents PageForeword.ivIntroduction.v1 Scope.12 Normative references.13Termsanddefinitions.14 Test conditions.54.1 Test chart illumination.54.2 Camera framing and lens focal length setting.54.3 Camera focusing.54.4 Camera settings.54.5 White balance.64.6 Luminance and colour measurements.64.7 Gamma correction.65 Visual resolution measurement.65.1 General.65.2 Test chart.75.3 Rules of judgement for visual observation.86 Edge-based spatial frequency response(e-SFR).96.1 General.96.2 Methodology.97 Sine-based spatial frequency response(s-SFR)measurement.128 Presentation of results.138.1 General.138.2 Resolution.138.3 Spatial frequency response(SFR).14Annex A(informative)CIPA resolution test chart.17Annex B(informative)Visual resolution measurement software.23Annex C(informative)Low contrast edge SFR test chart with OECF patches.28Annex D(normative)Edge spatial frequency response(e-SFR)algorithm.30Annex E(normative)Sine wave star test chart.33Annex F(normative)Sine wave Spatial Frequency Response(s-SFR)analysis algorithm.35Annex G(informative)Colour-filteredresolutionmeasurements.40Annex H(informative)Units and summary metrics.42Annex I(informative)OriginaltestchartdefinedinISO12233:2000.45Bibliography.49Copyright International Organization for Standardization Provided by IHS under license with ISO Licensee=University of Alberta/5966844001,User=sharabiani,shahramfsNot for Resale,02/25/2014 21:26:02 MSTNo reproduction or networking permitted without license from IHS-,-,-ISO 12233:2014(E)ForewordISO(the International Organization for Standardization)is a worldwide federation of national standards bodies(ISO member bodies).The work of preparing International Standards is normally carried out through ISO technical committees.Each member body interested in a subject for which a technical committee has been established has the right to be represented on that committee.International organizations,governmental and non-governmental,in liaison with ISO,also take part in the work.ISO collaborates closely with the International Electrotechnical Commission(IEC)on all matters of electrotechnical standardization.The procedures used to develop this document and those intended for its further maintenance are described in the ISO/IEC Directives,Part 1.In particular the different approval criteria needed for the different types of ISO documents should be noted.This document was drafted in accordance with the editorial rules of the ISO/IEC Directives,Part 2(see www.iso.org/directives).Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights.ISO shall not be held responsible for identifying any or all such patent rights.Details of any patent rights identified during the development of the document will be in the Introduction and/or on the ISO list of patent declarations received(see www.iso.org/patents).Any trade name used in this document is information given for the convenience of users and does not constitute an endorsement.For an explanation on the meaning of ISO specific terms and expressions related to conformity assessment,as well as information about ISOs adherence to the WTO principles in the Technical Barriers to Trade(TBT)see the following URL:Foreword-Supplementary informationThe committee responsible for this document is ISO/TC 42,Photography.This second edition cancels and replaces the first edition(ISO 12233:2000),which has been technically revised.iv ISO 2014 All rights reservedCopyright International Organization for Standardization Provided by IHS under license with ISO Licensee=University of Alberta/5966844001,User=sharabiani,shahramfsNot for Resale,02/25/2014 21:26:02 MSTNo reproduction or networking permitted without license from IHS-,-,-ISO 12233:2014(E)Introduction0.1 PurposeThe spatial resolution capability is an important attribute of an electronic still-picture camera.Resolution measurement standards allow users to compare and verify spatial resolution measurements.This International Standard defines terminology,test charts,and test methods for performing resolution measurements for analog and digital electronic still-picture cameras.0.2 Technical backgroundFor consumer digital cameras,the term resolution is often incorrectly interpreted as the number of addressable photoelements.While there are existing protocols for determining camera pixel counts,these should not be confused with the interpretation of resolution as addressed in this International Standard.Qualitatively,resolution is the ability of a camera to optically capture finely spaced detail,and is usually reported as a single valued metric.Spatial frequency response(SFR)is a multi-valued metric that measures contrast loss as a function of spatial frequency.Generally,contrast decreases as a function of spatial frequency to a level where detail is no longer visually resolved.This limiting frequency value is the resolution of the camera.A cameras resolution and its SFR are determined by a number of factors.These include,but are not limited to,the performance of the camera lens,the number of addressable photoelements in the optical imaging device,and the electrical circuits in the camera,which can include image compression and gamma correction functions.While resolution and SFR are related metrics,their difference lies in their comprehensiveness and utility.As articulated in this International Standard,resolution is a single frequency parameter that indicates whether the output signal contains a minimum threshold of detail information for visual detection.In other words,resolution is the highest spatial frequency that a candidate camera can usefully capture under cited conditions.It can be very valuable for rapid manufacturing testing,quality control monitoring,or for providing a simple metric that can be easily understood by end users.The algorithm used to determine resolution has been tested with visual experiments using human observers and correlates well with their estimation of high frequency detail loss.SFR is a numerical description of how contrast is changed by a camera as a function of the spatial frequencies that describe the contrast.It is very beneficial for engineering,diagnostic,and image evaluation purposes and serves as an umbrella function from which such metrics as sharpness and acutance are derived.Often,practitioners will select the spatial frequency associated with a specified SFR level as a modified non-visual resolution value.In a departure from the first edition of this International Standard,two SFR measurements are described.Additionally,the first SFR metrology method,edge-based spatial frequency response,is identical to that described in the first edition,except that a lower contrast edge is used for the test chart.Regions of interest(ROI)near slanted vertical and horizontal edges are digitized and used to compute the SFR levels.The use of a slanted edge allows the edge gradient to be measured at many phases relative to the image sensor photoelements and to yield a phase-averaged SFR response.A second sine wave-based SFR metrology technique is introduced in this edition.Using a sine wave modulated target in a polar format(e.g.Siemens star),it is intended to provide an SFR response that is more resilient to ill-behaved spatial frequency signatures introduced by the image content driven processing of consumer digital cameras.In this sense,it is intended to enable easier interpretation of SFR levels from such camera sources.Comparing the results of the edge-based SFR and the sine based SFR might indicate the extent to which nonlinear processing is used.The first step in determining visual resolution or SFR is to capture an image of a suitable test chart with the camera under test.The test chart should include features of sufficiently fine detail and frequency content such as edges,lines,square waves,or sine wave patterns.The test chart defined in this International Standard has been designed specifically to evaluate electronic still-picture cameras.It has not necessarily been designed to evaluate other electronic imaging equipment such as input scanners,CRT displays,hard-copy printers,or electro-photographic copiers,nor individual components of an electronic still-picture camera,such as the lens.ISO 2014 All rights reserved vCopyright International Organization for Standardization Provided by IHS under license with ISO Licensee=University of Alberta/5966844001,User=sharabiani,shahramfsNot for Resale,02/25/2014 21:26:02 MSTNo reproduction or networking permitted without license from IHS-,-,-ISO 12233:2014(E)Some of the measurements described in this International Standard are performed using digital analysis techniques.They are also applicable with the analogue outputs of the camera by digitizing the analogue signals if there is adequate digitizing equipment.0.3 Methods for measuring SFR and resolution selection rationale and guidanceThis section is intended to provide more detailed rationale and guidance for the selection of the different resolution metrology methods presented in this International Standard.While resolution metrology of analog optical systems,by way of spatial frequency response,is well established and largely consistent between methodologies(e.g.sine waves,lines,edges),metrology data for such systems is normally captured under well controlled conditions where the required data linearity and spatial isotropy assumptions hold.Generally,it is not safe to assume these conditions for files from many digital cameras,even under laboratory capture environments.Exposure and image content dependent image processing of the digital image file before it is provided as a finished file to the user prevents this.This processing yields different SFR responses depending on the features in the scene or in the case of this International Standard,the target.For instance,in-camera edge detection algorithms might specifically operate on edge features and selectively enhance or blur them based on complex nonlinear decision rules.Depending on the intent,these algorithms might also be tuned differently for repetitive scene features such as those found in sine waves or bar pattern targets.Even for constrained camera settings recommended in this International Standard,these nonlinear operators can yield differing SFR results depending on the target feature set.Naturally,this causes confusion on which targets to use,either alone or in combination.Guidelines for selection are offered below.Edges are common features in naturally occurring scenes.They also tend to act as visual acuity cues by which image quality is judged and imaging artefacts are manifested.This logic prescribed their use for SFR metrology in the past and current editions of this International Standard.It is also why edge features are prone to image processing in many consumer digital cameras:they are visually important.All other imaging conditions being equal,camera SFRs using different target contrast edge features can be significantly different,especially with respect to their morphology.This is largely due to nonlinear image processing operators and would not occur for strictly linear imaging systems.To moderate this behaviour,a lower contrast slanted edge feature(Figure C.1)was chosen to replace the higher contrast version of the first edition.This feature choice still allows for acuity-amenable SFR results beyond the half-sampling frequency and helps prevent nonlinear data clipping that can occur with high contrast target features.It is also a more reliable rendering of visually important contrast levels in naturally occurring scenes.Sine wave features have long been the choice for directly calculating SFR of analogue imaging systems and they are intuitively satisfying.They have been introduced into this edition of this International Standard based on experiences from the edge-based approach.Because sine waves transition more slowly than edges,they are not prone to being identified as edges in embedded camera processors.As such,the ambiguity that image processing imposes on the SFR can be largely avoided by their use.Alternatively,if the image processing is influenced by the absence of sharp features,more aggressive processing might be used by the camera.A sine wave starburst test pattern(Figure 6)is adopted in this edition.With the appropriate analysis software,a sine wave-based SFR can be calculated up to the half-sampling frequency.For the same reasons stated above,the sine wave-based target is also of low contrast and consistent with that of the edge-based version.An added benefit of the targets design over other sine targets is its compactness and bi-directional features.All experience suggests that there is no single SFR for todays digital cameras.Even under the strict capture constraints suggested in this International Standard,the allowable feature sets that most digital cameras offer prevent such unique characterization.Confusion can be reduced through complete documentation of the capture conditions and camera setting for which the SFR was calculated.It has been suggested that comparing edge-and sine wave-based SFR results under the same capture conditions could be a good tool in assessing the contribution of spatial image processing in digital cameras.Finally,at times,a full SFR characterization is simply not required,such as in end of line camera assembly testing.Alternately,SFR might be an intimidating obstacle to those not trained in its