# Inventive step in an augmented reality patent

Korean Patent Court case 2024Heo12395 examines whether image generation in an AR game could be combined with outdoor position and orientation tracking.

Source: https://www.iplexlaw.co.kr/en/blog/brunch-case-1930

HOME / NEWS & INSIGHTS NEWS & INSIGHTS Inventive step in an augmented reality patent Korean Patent Court case 2024Heo12395 examines whether image generation in an AR game could be combined with outdoor position and orientation tracking. Patents & Utility Models 2026.11.08 published IPLEX 7 min read For a virtual sign to appear fixed at a particular place as a camera turns, a system must know where the camera is and which way it faces. Does applying that position and orientation tracking to the overlay of virtual objects on real images involve an inventive step? In its judgment of 22 October 2026, the Korean Patent Court held that AR-game image processing could be combined with outdoor AR tracking (2024Heo12395). How the two systems could exchange and use information was central to the assessment of amended claim 7. Bringing camera position and orientation into the image Korean patent No. 755187 concerns a digital device and method for displaying virtual media on real images. Filed on 23 February 2006 and registered on 28 August 2007, it includes amended claim 7, the claim examined in this case. That claim concerns a camera-connected digital device combining real and virtual images for display. A virtual object is an object generated for display by a computer. Claim 7 uses the camera’s position and orientation to determine its field of view, compares that field with the position and orientation assigned to a virtual object, and generates virtual-image data. The resulting virtual image is combined with the camera’s real image. Figure 2 of Korean patent No. 755187: camera field of view and virtual objects Here, absolute coordinates correspond to actual positions on Earth. The court construed the term to include coordinates transformed into a local system while retaining that correspondence. Camera orientation includes rotation angles about three mutually perpendicular axes, at least one of which follows gravity or magnetic north. Magnetic north is the direction indicated by a compass. Figure 5 of Korean patent No. 755187: device position and orientation The amendments defined the features to be compared In invalidation proceedings, the patent owner requested an amendment to claim 7. On 26 April 2024, the Intellectual Property Trial and Appeal Board allowed the amendment in case 2023Dang3148, but held the amended claim invalid for lack of inventive step over prior art 1. The owner challenged that decision in court and separately sought a further amendment. The further wording specified that virtual-image data is generated by comparing the position and orientation assigned to the virtual object with the camera’s field of view. The Board initially rejected that separate request. The Patent Court set aside the rejection in case 2025Heo10204; the judgment became final after the Supreme Court dismissed the appeal in case 2026Hu10009. On reconsideration, the Board allowed the amendment on 7 July 2026, and that decision also became final. It was claim 7 in this amended form that the court examined in the present invalidation dispute. Image processing already disclosed in an AR game Prior art 3 was a Japanese patent publication from 2001 concerning an AR game device. A camera on a head-mounted display, or HMD, captures the player’s view of the real world. The game device generates a virtual-object image for that viewpoint, combines it with the camera image and displays the result on the HMD. Comparison of the patent’s displayed image and the display of prior art 3 The system manages the virtual object’s own position and orientation separately from those of the camera. It transforms the object’s location and direction into the camera viewpoint and takes the camera’s angle of view into account to determine how and where the object appears. The court found that this processing corresponded to the comparison of object pose and field of view required by claim 7. The owner argued that coordinate transformation alone did not disclose selecting or extracting the objects to display by comparison with the field of view. On the wording of claim 7, however, the court considered the comparison to be covered even when it occurs as part of image generation. A separate preliminary extraction step was not required. Three differences concerned a reference to the physical Earth The first difference was whether the camera position corresponded to an actual location on Earth. Prior art 3 used coordinates common to the camera and virtual objects, but did not disclose how those coordinates were tied to terrestrial positions. The second difference concerned the reference for camera orientation. Claim 7 specifies rotation angles about three perpendicular axes with a reference that includes gravity or magnetic north. The third was that the field of view used for comparison with the virtual object was likewise defined in coordinates corresponding to actual terrestrial positions. Prior art 4 was an outdoor AR modelling thesis published around 2004. It described transforming GPS positions between coordinate systems for use in 3D image generation. By accounting for sensor mounting position and direction, head height and similar offsets, the system could convert a position measured on the body into the viewpoint of a head-mounted camera. That thesis also described measuring direction and inclination using external references such as gravity and the geomagnetic field. The court considered that the sensor-to-camera mounting difference could be corrected and the camera’s orientation expressed as rotation angles about three perpendicular axes, one aligned with gravity. Figure 2-17 of prior art 4: TCM2 and InertiaCube2 tracking devices Why the court combined rendering with tracking As an illustration, imagine placing a virtual information sign at the entrance to a park. The visible area changes as a user walks and turns the camera. Referencing the camera and sign to the same map allows the system to calculate where the sign should appear in the current view and how it should be oriented. Prior art 3 performs its image calculations using a common coordinate system for the camera and virtual objects. Applying the tracking and coordinate transformations of prior art 4 would place both in that system while retaining their correspondence to terrestrial locations. The court held that camera position, orientation and angle of view could then define the field of view for comparison with the virtual object’s pose using the processing of prior art 3. Prior art 4 also described applying the software and equipment used for outdoor modelling to the ARQuake game. This supplied a reason to use outdoor tracking in an AR game. Both references described camera-based compositing, so the court found no particular difficulty in retaining the image-combination structure of prior art 3 while adopting the tracking and calibration of prior art 4. The resulting effects were predictable. The earlier amendment case used different prior art combinations Using the numbering in this article, the earlier amendment case assessed prior art 1 alone and the combination of prior art 1 with prior art 3. In particular, the court had found no adequate reason to add information about the virtual object’s own orientation to prior art 1 using prior art 3. The present case started instead from prior art 3, which already used the object’s own position and orientation, and asked whether the tracking and coordinate processing of prior art 4 could be applied. The court held that a person skilled in the art could readily arrive at amended claim 7 by combining prior art 3 and 4. It found a lack of inventive step and rejected the request to set aside the invalidation part of the Board’s decision. It did not decide the remaining grounds, including novelty. The challenge to the part of the 2024 decision allowing the amendment was dismissed as inadmissible, without a decision on its merits. The owner had obtained the amendment it had itself requested and therefore had no legal interest in seeking annulment of that favourable part. Practical implications for filing and amendment When preparing an AR patent application, examine not only the appearance of the displayed result but also the flow of data that produces it. Explaining how camera and object coordinates are aligned, and at what stage they are compared, helps identify the distinction from existing image processing. An amendment also calls for a fresh look at the prior art relevant to the added features. Here, the path connecting external position and orientation references to image generation, together with an existing application of that path in another context, supported the combination. Recording the problem at that interface, the proposed solution and its effects from the filing stage helps explain how the claimed approach differs from known techniques. The original figure labels and forms are preserved; the text explains the source material. Read the Korean source This article reflects the information available when it was published. Contact us to discuss your circumstances. Discuss this topic ↗ All articles Related service: Patents & utility models ↗ Related service: IP disputes & appeals ↗ ON THIS PAGE Bringing camera position and orientation into the image The amendments defined the features to be compared Image processing already disclosed in an AR game Three differences concerned a reference to the physical Earth Why the court combined rendering with tracking The earlier amendment case used different prior art combinations Practical implications for filing and amendment TALK TO IPLEX Discuss your IP questions We consider your technology and business needs together. ↗ Contact us Newer Trademark owner bankruptcy and registration of an exclusive licence ↗ Older Tencent’s AI background-removal patent: different boundary treatment for hair and the face ↗ Related insights Patents & Utility Models 2026.11.19 Narrowing a medical-use claim: what supports the patient subgroup? A Korean linagliptin judgment distinguishes sufficient disclosure of a therapeutic effect from whether use in a defined patient group was inventive. ↗ Read article Patents & Utility Models 2026.11.18 A prior-art defence after a binding finding of literal coverage A Korean louvre patent dispute shows why the binding effect of an earlier judgment matters when a scope-confirmation case returns to the tribunal. ↗ Read article Patents & Utility Models 2026.11.17 Dish-rack patent infringement: why the court awarded treble damages A Korean dish-rack dispute separates product structure from assembly practice and examines distinct post-amendment sales, intent and enhanced damages. ↗ Read article

- https://www.iplexlaw.co.kr/en
- https://www.iplexlaw.co.kr/en/blog/category/patent
- https://www.iplexlaw.co.kr/ko/blog/brunch-case-1930
- https://www.iplexlaw.co.kr/en/contact
- https://www.iplexlaw.co.kr/en/blog
- https://www.iplexlaw.co.kr/en/ip-solutions/patent#related-insights
- https://www.iplexlaw.co.kr/en/ip-solutions/disputes#related-insights
- https://www.iplexlaw.co.kr/en/blog/brunch-case-1930#article-1930-en-0
- https://www.iplexlaw.co.kr/en/blog/brunch-case-1930#article-1930-en-1
- https://www.iplexlaw.co.kr/en/blog/brunch-case-1930#article-1930-en-2
- https://www.iplexlaw.co.kr/en/blog/brunch-case-1930#article-1930-en-3
- https://www.iplexlaw.co.kr/en/blog/brunch-case-1930#article-1930-en-4
- https://www.iplexlaw.co.kr/en/blog/brunch-case-1930#article-1930-en-5
- https://www.iplexlaw.co.kr/en/blog/brunch-case-1930#article-1930-en-6
- https://www.iplexlaw.co.kr/en/contact
- https://www.iplexlaw.co.kr/en/blog/brunch-case-1931
- https://www.iplexlaw.co.kr/en/blog/tencent-portrait-matting-trimap
- https://www.iplexlaw.co.kr/en/blog/brunch-case-1975
- https://www.iplexlaw.co.kr/en/blog/brunch-case-1975
- https://www.iplexlaw.co.kr/en/blog/brunch-case-1971
- https://www.iplexlaw.co.kr/en/blog/brunch-case-1971
- https://www.iplexlaw.co.kr/en/blog/brunch-case-1967
- https://www.iplexlaw.co.kr/en/blog/brunch-case-1967
