Blog Post 1: Critical Analysis and Evaluation of a Master’s Thesis

Mindful Navigation with Guiding Light: Design Considerations for Projector Based Indoor Navigation Assistance System

I chose the dissertation „Mindful Navigation with Guiding Light: Design Considerations for Projector Based Indoor Navigation Assistance System“ by Jaewoo Chung. It was submitted to the Massachusetts Institute of Technology (MIT) in February 2012. It investigates problems associated with conventional navigation assistance systems, particularly the concern that users can become disengaged from their physical surroundings when following instructions on a screen. Chung connects this problem to theories of visual attention as well as mindfulness and mindlessness. As an alternative, he develops Guiding Light, a projector-based navigation system that places guidance information directly into the surrounding physical environment. Instead of looking down at a separate screen, users receive information projected onto floors, walls, maps, and other surfaces. The dissertation is structured into an introduction, background and related work, the development of Guiding Light, research into indoor positioning using geomagnetism, a detailed system description, an evaluation, and a conclusion. The practical work therefore consists not only of the Guiding Light interface but also of the technical infrastructure required to make the system function, particularly its indoor positioning system.

In terms of the quality of design and execution, the project is technically ambitious and demonstrates a substantial amount of development work. Chung does not present Guiding Light as a single finished prototype but documents several iterations. Version 1 combined a pico-projector with magnetic, infrared, proximity, and orientation sensors connected to a Nokia N95. Version 2 introduced infrared beacons and a camera to improve positioning and interaction, while Version 3 investigated a camera-based computer-vision approach. This iterative development is one of the strongest aspects of the project because the author evaluates the advantages and disadvantages of different technological approaches instead of assuming that the first solution is sufficient. The final design decision to favour a sensor-based approach over computer vision is also justified in relation to processing power, scalability, data requirements, and the limitations of mobile devices. From a design perspective, the project is convincing conceptually, although the visual quality of the prototype itself is understandably constrained by the technology available at the time. The system is more successful as a research prototype than as a polished final product.

The degree of innovation is particularly high. Projection, augmented reality, and indoor navigation were already established areas of research, so the individual technologies were not completely new. However, their combination with the concept of mindful navigation creates a distinctive research direction. Chung proposes that the environment itself can become the interface, using projected information to guide users while keeping their attention directed towards the surrounding space. The dissertation also contributes technically through its magnetic-field-based indoor positioning system. The system uses distortions in indoor magnetic fields as location fingerprints and was reported to achieve positioning within one metre for 88% of measurements, with an average directional error of four degrees. The combination of interaction design, navigation research, psychology, projection-based augmented reality, and indoor positioning therefore goes beyond a conventional interface design project.

The criterion of independence is also strongly fulfilled. The dissertation demonstrates that Chung independently explored different technological approaches and developed several generations of the prototype. The work involved not only interface design but also hardware, software, positioning algorithms, route planning, and evaluation. The development history shows that decisions were made in response to practical problems encountered during the research. For example, the camera-based version offered greater potential for interaction but introduced higher computational requirements and scalability problems, leading to the decision to return to a sensor-based solution. This gives the work a clear individual research direction rather than making it appear to be a simple implementation of an existing system.

The organisation and structure of the dissertation are generally logical and academically appropriate. The argument develops from the problem of navigation assistance and its theoretical background towards the Guiding Light concept, prototype development, indoor positioning, the complete system, and finally user evaluation. The table of contents shows a clear progression from theory to implementation and testing. The main weakness is the breadth of the project. Two major technical areas—the Guiding Light interface and the magnetic indoor positioning system—receive substantial attention. This makes the dissertation comprehensive, but it also creates the impression that several research projects are being combined into one. The technical positioning research can at times overshadow the central interaction-design question of whether projection actually improves engagement with the environment.

Regarding quality of communication, the thesis is generally understandable and supported by numerous diagrams, photographs, system architectures, and descriptions of the different prototypes. The visual documentation is particularly important because many aspects of the system would be difficult to understand through text alone. The prototype iterations, interaction scenarios, and technical components are made relatively concrete through this material. At the same time, the communication is sometimes weakened by the highly technical sections. Readers primarily interested in interaction design may find the descriptions of sensors, algorithms, magnetic fingerprints, and system architecture difficult to follow. There are also linguistic and grammatical imperfections throughout the dissertation. These do not prevent understanding, but they reduce the overall polish expected from a highly developed academic publication.

The scope of the work is both a strength and a weakness. For a PhD dissertation, the breadth is understandable and demonstrates considerable ambition. For a Master’s-level project, however, the scope would arguably be excessive. The research covers theoretical psychology, visual attention, navigation, augmented reality, interaction design, hardware development, software development, indoor positioning, computer vision, route planning, and empirical user research. This allows Chung to investigate the problem from multiple perspectives, but it also means that some areas are not explored with the same depth. The project would potentially be stronger from a design-research perspective if the central research question were narrower and the technical development were more clearly subordinated to it.

In terms of spelling, care, and accuracy, the technical documentation is one of the strongest parts of the dissertation. Hardware configurations, prototype versions, positioning methods, system architecture, experimental conditions, and evaluation procedures are described in considerable detail. The author also openly discusses the weaknesses of the different prototypes, which increases the credibility of the research. However, spelling, grammar, and typographical errors occur throughout the document. The writing therefore does not always match the otherwise high level of technical care. The visual material and technical descriptions are generally systematic, but the linguistic presentation could have been more carefully edited.

The use of literature is appropriate to the interdisciplinary nature of the research. Chung draws on research concerning navigation assistance, visual attention, mindfulness and mindlessness, indoor positioning, augmented reality, and human-computer interaction. The literature is used not only as background information but also to establish the central research problem: that navigation technologies can influence how users engage with and understand their surroundings. The theoretical framework consequently has a meaningful relationship with the practical work rather than functioning as a separate literature review. One limitation is that, because the dissertation was submitted in 2012, some of the technologies and research contexts are necessarily dated from a contemporary perspective. This is not a weakness in relation to the time of submission, but it is important when assessing the work today.

The practical project is perhaps the most interesting aspect of the dissertation from a design-research perspective. The relationship between research question, theoretical framework, and implementation is unusually direct. The theoretical concern is that screen-based navigation can divide visual attention and disengage users from their environment. The practical response is therefore to move the navigation information from the screen into the environment itself. The artifact is not simply an illustration of the theory; it is the means through which the theory is tested.

The documentation of the practical work is detailed and generally comprehensible. The three prototype generations are described together with their respective strengths and weaknesses, and the final system architecture is explained in later chapters. The thesis also describes concrete interaction scenarios, such as selecting a destination, interacting with a map, and receiving projected directions at decision points. However, the artifact is less accessible as an independent design piece. The dissertation provides photographs and technical documentation, but there is no readily accessible prototype that allows a reader today to experience the interaction directly. As a result, the documentation communicates how the system was constructed more effectively than how it felt to use.

The evaluation is a particularly important strength because it does not simply confirm Chung’s initial assumptions. The study compared projector-based guidance with screen-based guidance and measured factors including navigation errors, travel time, stops, confusion, and head orientation. The Guiding Light group made fewer errors, spent less time looking at a device, and showed greater orientation towards the surrounding environment. However, later results showed that route choice and user control could have a stronger influence on engagement than the difference between projector and screen. Chung himself acknowledges that removing the screen does not necessarily guarantee greater engagement with the environment. This critical interpretation strengthens the academic quality of the project because the artifact is used to investigate a question rather than simply to prove that the proposed concept works.

Overall, the work demonstrates a high level of academic and practical development, although its status as a PhD dissertation makes direct comparison with a Master’s thesis difficult. Its main strengths are its innovative combination of theory and technology, the extensive prototype development, the detailed technical documentation, and the empirical evaluation of the final concept. Its main weaknesses are its very broad scope, technical complexity, inconsistent linguistic quality, and limited accessibility of the artifact itself. From a design perspective, the project is more convincing as a research prototype than as a finished product, but this is appropriate to its research purpose. The strongest lesson is that the practical artifact becomes academically valuable because it is clearly connected to a research question and is subsequently evaluated against that question.

For my own academic work, the most relevant lesson is therefore not simply the use of projected light, but Chung’s approach to connecting theory, design decisions, prototyping, and evaluation. Particularly valuable is the way different prototype versions are documented together with their limitations instead of presenting only the successful final result. This makes the development process transparent and demonstrates independent critical decision-making. At the same time, I would approach the scope more carefully. Chung’s dissertation shows how quickly a design project can expand when interaction design, technology development, and empirical research are all pursued simultaneously. A more focused research question and a clearly defined evaluation strategy could make a comparable project easier to communicate and assess.

In conclusion, Mindful Navigation with Guiding Light is an ambitious and innovative piece of practice-based research with a strong connection between theoretical argument and practical implementation. It is technically impressive, independently developed, and supported by substantial documentation and evaluation. Its weaknesses mainly concern its extensive scope, technical density, linguistic imperfections, and the fact that the physical artifact is not easily accessible outside the dissertation. Despite these limitations, the work demonstrates an important principle of academic design research: a practical artifact should not exist only as a demonstration of technical ability, but should function as a way of investigating and critically testing a research argument. This is ultimately what makes Chung’s project a valuable example of research through design.

TRUMMER JULIA – Blog

Introduction to the Master’s Thesis

Author: Adriana Mesquita Machado 

Title: The Co-existence of Dark and Light Patterns in the Web: Development of a Lighter-Darkness Media Toolbox for Responsible Design 

Portuguese title: A Coexistência de Padrões Dark e Light na Web: Desenvolvimento de uma Ferramenta Lighter-Darkness Media para o Design Responsável 

Year: 2023 

Institution / degree: University of Aveiro, Master’s in Communication and Web Technologies. 

Critical Analysis and Evaluation of a Master’s Thesis

I really enjoyed reading this thesis. It’s well structured without being designed at all and it was easy to follow from the start to finish. The author writes in a very orderly way and her reasoning makes sense throughout. Already in her Introduction she sets the problem, her research question and her goals. I already researched deceptive patterns myself and they are already well researched, so the topic itself doesn’t feel to innovative, but I think her toolbox is an important step towards making the topic useful for every designer. I especially liked that she didn’t stop at building the tool. She tested it with designers, got feedback and improved the toolbox. I believe the scope is impressive for a master’s thesis. She seems decisive and independent the whole way through. Also the literature review is solid, though a few more recent sources would have helped.

Evaluation of the Practical Project / Work Produced

Does the thesis successfully connect the research question, theoretical framework, and practical implementation?

Yes, very much so. Her research question, “What are the web design guidelines that inform the implementation of a lighter-darkness media toolbox?”. I think she did a great job of connecting it with the theoretical framework. The practical implementation was also great, since she really put in a lot of effort and worked with designers to improve the first version of her toolbox.

Is the documentation of the practical project clear, comprehensible, and sufficiently detailed?

The author described each step of her practical work. Starting from the moodboard and design decisions she made to the sections of her toolbox. She documented everything very well and used many screenshots and photos of her work.

In your opinion, does the quality and level of development of the practical project meet the requirements of a Master’s thesis?

In the end the toolbox is still a prototype and not a final product. This is also what the author said herself. For a master’s thesis, building a tool which also used real user input and testing is a complete and well executed design cycle and worth being called a master’s thesis. This is what I would expect from a master’s thesis.

Final Conclusion

In general, I think this is a very good and comprehensive master’s thesis. It is structured very well and is easy to read. It also connects the research question to the theory and especially the practical work. What especially stood out to me was that she didn’t just create a toolbox but also tested and then improved it through testing.

Relevance to Your Own Final Thesis

Finally, I think that the structure and also the research methods the author of this master’s thesis used is something I also would like to implement in my own master’s thesis. For me its really important to have a real outcome because I want it to be a useful work in the end. Since I think this master’s thesis is outstanding I wouldn’t really change anything.

1# [personalized navigation experience] – Proseminar Master´s Thesis

IMPULSE #1 – Critical examination of TU Wien thesis

For this activity, I read a master’s thesis from a similar master’s program (Media and Human Centered Computing) at TU Wien. The thesis was written by Silke Buchberger, BSc in 2024 and is titled “Investigating Creativity Support Opportunities through Digital Tools in Dance”.

In short, the thesis follows an exploratory research-through-design approach to developing a non-screen digital artifact to help dancers in their creative choreographic process. It follows a traditional structure, introducing first the topic, talking about related work, and then following on to the methodology – research, design, and evaluation – and finally ending with discussions and conclusions. In the end, the artifact Movement Xplorer (a creative support tool for dance) is produced as part of the thesis.

In regards to the academic quality, the following is an evaluation based on different criteria that we previously used to examine a thesis written at FH in class.

1. Quality of design and execution

The layout of the actual text was very basic, but consistent throughout. The textual design resembles that of a scientific journal, in contrast to some of the FH theses that were consulted beforehand. However, the quality of the research-through-design documentation and of the design of the actual final artifact are exceptional, and the scientific perspective given throughout the whole text elevates its perceived value. Overall, from the process to the artifact, the thesis is masterfully executed.

2. Degree of innovation

As it is such a niche topic that doesn’t have as much research in it, this thesis embodies a high degree of innovation. The author uses well-known and well-studied methods and applies it to her own area of interest in a non-conventional research topic.

3. Independence

The work demonstrates a high degree of independence and originality, stemming likely from the fact that the author chose a topic that she was passionate about and knowledgeable in, borrowing from her personal experience. She does not mention any AI usage in the whole thesis, and since her artifact is non-digital, there is a higher probability that this is a reliable statement.

4. Organisation and structure

The thesis is very well structured, considering both a scientific and designerly point of view. The author takes her own experience as a dancer and dance teacher and couples it with an extensive literature review, in order to inform her user research methods. Through these, she develops a prototype which, through iterative design, becomes the final artifact (Movement Xplorer) which she subjects through an evaluation with users.

5. Quality of communication

The thesis is exceptionally well communicated, including diagrams and figures to support the reader’s understanding of the text. The author clearly communicates each step and mental note that she underwent throughout the whole research-through-design process. She very clearly explains the relevance of each research process and data collected towards the initial research questions and final artifact, which strengthens the degree of quality of the work.

6. Scope of the thesis

The thesis encompasses a very wide scope in a very niche field. While the author specifically decides to focus on supporting creative processes in dance, she uses various types of research methods and doesn’t limit herself to any one area of dance. This is a particular strength of this work, as its wide scope in research methods doesn’t diminish the breadth that it could (and did) obtain throughout.

7. Spelling, care, and accuracy

The work presents a high degree of attention, with minimal spelling and accuracy mistakes. The only thing to note was that in some parts of the text, the author speaks in the first person; in others, she uses a more colloquial style of writing. While this should not diminish her impactful work, it does speak to a lower degree of formality that affects how an experienced scientific reader perceives it.

8. Use of literature

The quality of the references used in the thesis exceeds expectations, as they are all from reputable sources. A majority of citations came from peer-reviewed journal articles, with a couple coming from primary online sources (such as Troikatronix and Living Archive by Wayne McGregor, two projects, which are 2 pieces of software not described in scientific literature but relevant to the topic in regard to related work).

The thesis successfully connects the research question, theoretical framework, and practical implementation. One must also highlight the fact that the author not only makes the relationship between research question, theoretical framework, and practical implementation clear in the text, but also, she adds a diagram encompassing the whole project and strengthening the connection between all of these.

The documentation of the practical project created (Movement Xplorer) was clear, comprehensible, and sufficiently detailed. The author includes copious amounts of documentation for each of her user research methods, including reflections and insights that she, as researcher, obtained from each of them. Plus, she includes an extensive appendix where the reader can see her survey questionnaire, the code to her prototype, and the acceleration data plots.

In my opinion, the quality and level of development of the practical project exceeds the requirements of a Master’s thesis. She created a prototype using Adafruit’s Circuit Playground Bluefruit, which can be used in what she refers to as a tangible mode (ie. a separate object, not attached to the user, that he or she can interact with) and a wearable mode. For the wearable mode, the microcontroller is placed inside a piece of fabric which can be worn either on the head, around the shoulder, or on the hip.

Regarding the overall work, its biggest strengths lie in the high standard of quality that the author subjected herself to. The research seems to have been meticulously done, the findings easily captured in appropriate formats, and the insights properly communicated throughout each step. On the other hand, its biggest weakness is in the formality of the writing style. Since it’s a very personalized thesis and a lot of the first-person writing faults are done in parts where the author explains her insights and her autoethnographic reflections I can forgive it, but I would be amiss to not point out this style fault (for a master’s thesis). For these reasons, I would think that the author got a 1 (sehr gut) on the thesis for her efforts, as almost everything exceeds expectations except for the writing style.

I chose this particular thesis to read and critically examine because it is very similar to my own, combining both the human-centered design research approaches for a niche sport-related topic (in her case, supporting dance choreography, and in mine, supporting proprioceptive communication). I would like to implement the same structure of the overall work, the inclusion of autoethnography, and the clarity of each step in the research-through-design process in my own thesis. Plus, I greatly value the quality of her cited works and I’ll definitely have to read the ones that are also relevant to my own work. However, even though I’d like to improve the writing style in my future thesis, it’s a challenge for the personal findings, and thus I’ll have to read more about how I could overcome this.


ACCOMPANYING LINKS

Source:

Buchberger, S. (2024). Investigating Creativity Support Opportunities through Digital Tools in Dance. Retrieved on 12 Oct 2026 from: https://repositum.tuwien.at/bitstream/20.500.12708/197487/1/Buchberger%20Silke%20-%202024%20-%20Investigating%20creativity%20support%20opportunities%20through…pdf

Further reading:

Book on Autoethnography: https://onlinelibrary.wiley.com/doi/pdf/10.1002/9781118901731.iecrm0011

Chapter on Laban Movement Analysis: https://link.springer.com/chapter/10.1007/978-3-319-25739-6_13