Publications

2020

• C. S. de Souza, “Sujeitos ocultos e indeterminados da computação,” Sbc horizontes, vol. Oct 2020, p. 1 html page, 2020.
  [BibTeX] [Abstract] [Download PDF]
  

  Uma das tradições persistentes da pesquisa na área de computação e das atividades profissionais de desenvolvimento de software é a tendência a não tratar da subjetividade presente nos processos de investigação científica e produção de tecnologia, exceto quando se trata de levantar requisitos para satisfazer os usuários, clientes e outras partes envolvidas em tecnologias específicas. A subárea de Interação Humano-Computador (IHC) é centralmente incumbida deste tipo de tarefa e tem, ao longo dos anos, se debruçado sobre questões cada vez mais espinhosas para a sociedade como um todo, e não apenas para o círculo de usuários e clientes desta ou daquela tecnologia. Os avanços da Inteligência Artificial (IA), por exemplo, têm mostrado com clareza que há mais humanos de quem tratar na computação do que os usuários. Entretanto, os fundamentos teóricos da computação, que preparam o caminho para cientistas e profissionais técnicos que vão atuar em um dos setores de maior impacto social neste início de século, continuam distantes das subjetividades que tão claramente estão em jogo em tudo o que fazemos. Mas como incluí-las no chamado núcleo duro da Computação? Aliás, por que “núcleo duro”? Hora de rever conceitos e práticas!

  @Article{Souza2020SujeitosOcultose,
  abstract = {Uma das tradições persistentes da pesquisa na área de computação e das atividades profissionais de desenvolvimento de software é a tendência a não tratar da subjetividade presente nos processos de investigação científica e produção de tecnologia, exceto quando se trata de levantar requisitos para satisfazer os usuários, clientes e outras partes envolvidas em tecnologias específicas. A subárea de Interação Humano-Computador (IHC) é centralmente incumbida deste tipo de tarefa e tem, ao longo dos anos, se debruçado sobre questões cada vez mais espinhosas para a sociedade como um todo, e não apenas para o círculo de usuários e clientes desta ou daquela tecnologia. Os avanços da Inteligência Artificial (IA), por exemplo, têm mostrado com clareza que há mais humanos de quem tratar na computação do que os usuários. Entretanto, os fundamentos teóricos da computação, que preparam o caminho para cientistas e profissionais técnicos que vão atuar em um dos setores de maior impacto social neste início de século, continuam distantes das subjetividades que tão claramente estão em jogo em tudo o que fazemos. Mas como incluí-las no chamado núcleo duro da Computação? Aliás, por que “núcleo duro”? Hora de rever conceitos e práticas!},
  author = {Clarisse Sieckenius de Souza},
  journal = {SBC Horizontes},
  pages = {1 html page},
  title = {Sujeitos Ocultos e Indeterminados da Computação},
  volume = {Oct 2020},
  year = {2020},
  month = oct,
  url = {http://horizontes.sbc.org.br/index.php/2020/10/sujeitos-ocultos-e-indeterminados-da-computacao/},
  issn = {2175-9235},
  owner = {SERG},
  publisher = {Sociedade Brasileira de Computação},
  timestamp = {2020-10-21},
  }

2019

• R. {Brandão}, J. {Carbonera}, C. {de Souza}, J. {Ferreira}, B. {Gonçalves}, and C. {Leitão}, “Mediation challenges and socio-technical gaps for explainable deep learning applications,” Arxiv e-prints, p. arXiv:1907.07178, 2019.
  [BibTeX] [Abstract] [Download PDF]
  

  The presumed data owners’ right to explanations brought about by the General Data Protection Regulation in Europe has shed light on the social challenges of explainable artificial intelligence (XAI). In this paper, we present a case study with Deep Learning (DL) experts from a research and development laboratory focused on the delivery of industrial-strength AI technologies. Our aim was to investigate the social meaning (i.e. meaning to others) that DL experts assign to what they do, given a richly contextualized and familiar domain of application. Using qualitative research techniques to collect and analyze empirical data, our study has shown that participating DL experts did not spontaneously engage into considerations about the social meaning of machine learning models that they build. Moreover, when explicitly stimulated to do so, these experts expressed expectations that, with real-world DL application, there will be available mediators to bridge the gap between technical meanings that drive DL work, and social meanings that AI technology users assign to it. We concluded that current research incentives and values guiding the participants’ scientific interests and conduct are at odds with those required to face some of the scientific challenges involved in advancing XAI, and thus responding to the alleged data owners’ right to explanations or similar societal demands emerging from current debates. As a concrete contribution to mitigate what seems to be a more general problem, we propose three preliminary XAI Mediation Challenges with the potential to bring together technical and social meanings of DL applications, as well as to foster much needed interdisciplinary collaboration among AI and the Social Sciences researchers.

  @Article{Brandao2019MediationChallengesSocio,
  abstract = {The presumed data owners' right to explanations brought about by the General Data Protection Regulation in Europe has shed light on the social challenges of explainable artificial intelligence (XAI). In this paper, we present a case study with Deep Learning (DL) experts from a research and development laboratory focused on the delivery of industrial-strength AI technologies. Our aim was to investigate the social meaning (i.e. meaning to others) that DL experts assign to what they do, given a richly contextualized and familiar domain of application. Using qualitative research techniques to collect and analyze empirical data, our study has shown that participating DL experts did not spontaneously engage into considerations about the social meaning of machine learning models that they build. Moreover, when explicitly stimulated to do so, these experts expressed expectations that, with real-world DL application, there will be available mediators to bridge the gap between technical meanings that drive DL work, and social meanings that AI technology users assign to it. We concluded that current research incentives and values guiding the participants' scientific interests and conduct are at odds with those required to face some of the scientific challenges involved in advancing XAI, and thus responding to the alleged data owners' right to explanations or similar societal demands emerging from current debates. As a concrete contribution to mitigate what seems to be a more general problem, we propose three preliminary XAI Mediation Challenges with the potential to bring together technical and social meanings of DL applications, as well as to foster much needed interdisciplinary collaboration among AI and the Social Sciences researchers.},
  author = {{Brand{\~a}o}, Rafael and {Carbonera}, Joel and {de Souza}, Clarisse and {Ferreira}, Juliana and {Gon{\c{c}}alves}, Bernardo and {Leit{\~a}o}, Carla},
  journal = {arXiv e-prints},
  pages = {arXiv:1907.07178},
  title = {Mediation Challenges and Socio-Technical Gaps for Explainable Deep Learning Applications},
  year = {2019},
  month = jul,
  url = {https://arxiv.org/abs/1907.07178},
  adsnote = {Provided by the SAO/NASA Astrophysics Data System},
  adsurl = {https://ui.adsabs.harvard.edu/abs/2019arXiv190707178B},
  archiveprefix = {arXiv},
  eid = {arXiv:1907.07178},
  eprint = {1907.07178},
  keywords = {Computer Science - Artificial Intelligence, Computer Science - Human-Computer Interaction, Computer Science - Machine Learning},
  owner = {SERG},
  primaryclass = {cs.AI},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, “A contrastive study of pre- and post-legislation interaction design for communication and action about personal data protection in e-commerce websites,” in Human-computer interaction – interact 2019, Cham, 2019, p. 3–23. doi:https://doi.org/10.1007/978-3-030-29387-1_1
  [BibTeX] [Abstract] [Download PDF]
  

  The European General Data Protection Regulation (GDPR) has had a major impact on data collection and processing practices. It has also challenged interaction design aiming to support the effectiveness of data owners’ rights, their informed decisions, and their actions regarding how personal information is used by companies, governments, and others. Similar legislation has been issued in various non-European countries, which means that, in this respect, the HCI community has an important role to play for users all over the world. This paper presents the conclusions of a contrastive study with four major e-commerce websites in Portugal, where data protection law has been effective since 2018, and four analogs in Brazil, where the national Data Protection Law (DPL) has been sanctioned but will only be effective in 2020. The purpose of the study is to examine the pre-legislation to post-legislation evolution in the design of interaction for communication and action about personal data protection matters, so as to anticipate some of the threats and opportunities ahead of us. Using concepts and elements of Semiotic Engineering methods and techniques, we found that, within the scope of this study, GDPR seems to have had little impact on what European users can do and experience online, compared to pre-DPL Brazilian users. We discuss some of the possible reasons for this and conclude with thoughts on the role of interaction design in empowering data owners for this new regulation era.

  @InProceedings{Souza2019ContrastiveStudyPre,
  abstract = {The European General Data Protection Regulation (GDPR) has had a major impact on data collection and processing practices. It has also challenged interaction design aiming to support the effectiveness of data owners' rights, their informed decisions, and their actions regarding how personal information is used by companies, governments, and others. Similar legislation has been issued in various non-European countries, which means that, in this respect, the HCI community has an important role to play for users all over the world. This paper presents the conclusions of a contrastive study with four major e-commerce websites in Portugal, where data protection law has been effective since 2018, and four analogs in Brazil, where the national Data Protection Law (DPL) has been sanctioned but will only be effective in 2020. The purpose of the study is to examine the pre-legislation to post-legislation evolution in the design of interaction for communication and action about personal data protection matters, so as to anticipate some of the threats and opportunities ahead of us. Using concepts and elements of Semiotic Engineering methods and techniques, we found that, within the scope of this study, GDPR seems to have had little impact on what European users can do and experience online, compared to pre-DPL Brazilian users. We discuss some of the possible reasons for this and conclude with thoughts on the role of interaction design in empowering data owners for this new regulation era.},
  address = {Cham},
  author = {de Souza, Clarisse Sieckenius},
  booktitle = {Human-Computer Interaction -- INTERACT 2019},
  editor = {Lamas, David and Loizides, Fernando and Nacke, Lennart and Petrie, Helen and Winckler, Marco and Zaphiris, Panayiotis},
  pages = {3--23},
  publisher = {Springer International Publishing},
  title = {A Contrastive Study of Pre- and Post-legislation Interaction Design for Communication and Action About Personal Data Protection in e-Commerce Websites},
  year = {2019},
  doi = {https://doi.org/10.1007/978-3-030-29387-1_1},
  isbn = {978-3-030-29387-1},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {https://link.springer.com/chapter/10.1007/978-3-030-29387-1_1},
  }

• A. Lopes, E. Oliveira, T. Conte, and C. Sieckenius de Souza, “Directives of communicability: towards better communication through software models,” in 2019 ieee/acm 12th international workshop on cooperative and human aspects of software engineering (chase), 2019, p. 45–48. doi:10.1109/CHASE.2019.00019
  [BibTeX] [Abstract]
  

  In the development process, software models are commonly used to support communication among members of the development team. The risks of miscommunication through software models relate to the model content and to how content is expressed by the modeler. Communication failures mediated by software models may generate inconsistencies in software behavior, generating rework to correct them later. Aiming to improve model communication quality between their producers and consumers, we developed the Directives of Communicability (DCs). The aim of this paper is to present the DCs and an empirical study. The empirical study indicated that the directives had the intended potential to reduce miscommunication of what software models meant to those who produced them. From the results of this study, we notice that DCs can improve communication quality between model producers and consumers. Our results also show that DCs helped the producers’ reflections on their models’ content.

  @InProceedings{Lopes2019DirectivesCommunicabilityTowards,
  abstract = {In the development process, software models are commonly used to support communication among members of the development team. The risks of miscommunication through software models relate to the model content and to how content is expressed by the modeler. Communication failures mediated by software models may generate inconsistencies in software behavior, generating rework to correct them later. Aiming to improve model communication quality between their producers and consumers, we developed the Directives of Communicability (DCs). The aim of this paper is to present the DCs and an empirical study. The empirical study indicated that the directives had the intended potential to reduce miscommunication of what software models meant to those who produced them. From the results of this study, we notice that DCs can improve communication quality between model producers and consumers. Our results also show that DCs helped the producers' reflections on their models' content.},
  author = {A. {Lopes} and E. {Oliveira} and T. {Conte} and C. {Sieckenius de Souza}},
  booktitle = {2019 IEEE/ACM 12th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE)},
  pages = {45--48},
  title = {Directives of Communicability: Towards Better Communication through Software Models},
  year = {2019},
  month = {May},
  doi = {10.1109/CHASE.2019.00019},
  issn = {2574-1837},
  keywords = {product development;software engineering;software models;model content;modeler;communication failures;model communication quality;model producers;directives of communicability;DC;model consumers;Software;Unified modeling language;Computational modeling;Semiotics;Adaptation models;Context modeling;Planning;human-centered computing;semiotic engineering;design science research;communication through software models},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• A. Lopes, E. Oliveira, T. Conte, and C. S. de Souza, “Directives of communicability: teaching students how to improve communication through software modeling,” in 2019 ieee/acm 41st international conference on software engineering: companion proceedings (icse-companion), 2019, p. 306–307. doi:10.1109/ICSE-Companion.2019.00127
  [BibTeX] [Abstract]
  

  In the development process, software models are used to support communication among development team members. Failures of communication that is mediated by software models may generate inconsistencies in software behavior, generating rework to correct them. This may occur because producers usually focus only on model content, although they should also reflect on how other members of the development team will interpret their models. We should therefore teach software engineering students how to communicate better through software models. In an attempt to improve communication through software models, we have developed the Directives of Communicability (DCs), based on theories that investigate different kinds of communication. In this poster, we present the highlights of a study to find out whether DCs improve software engineering students’ communication through software models. Our results confirm that DCs have improved the students’ reflections on how their models’ content will be interpreted during the software development process.

  @InProceedings{Lopes2019DirectivesCommunicabilityTeaching,
  abstract = {In the development process, software models are used to support communication among development team members. Failures of communication that is mediated by software models may generate inconsistencies in software behavior, generating rework to correct them. This may occur because producers usually focus only on model content, although they should also reflect on how other members of the development team will interpret their models. We should therefore teach software engineering students how to communicate better through software models. In an attempt to improve communication through software models, we have developed the Directives of Communicability (DCs), based on theories that investigate different kinds of communication. In this poster, we present the highlights of a study to find out whether DCs improve software engineering students' communication through software models. Our results confirm that DCs have improved the students' reflections on how their models' content will be interpreted during the software development process.},
  author = {A. {Lopes} and E. {Oliveira} and T. {Conte} and C. S. {de Souza}},
  booktitle = {2019 IEEE/ACM 41st International Conference on Software Engineering: Companion Proceedings (ICSE-Companion)},
  pages = {306--307},
  title = {Directives of Communicability: Teaching Students How to Improve Communication Through Software Modeling},
  year = {2019},
  month = {May},
  doi = {10.1109/ICSE-Companion.2019.00127},
  issn = {2574-1934},
  keywords = {computer aided instruction;computer science education;human computer interaction;software engineering;teaching;software development process;software modeling;directives of communicability;DCs;development team members;software engineering students teaching;software engineering students communication;Software;Unified modeling language;Computational modeling;Software engineering;Training;Semiotics;human-centered computing, semiotic engineering, communication through software models},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• P. C. Ribeiro, G. G. Schardong, S. D. J. Barbosa, C. S. de Souza, and H. Lopes, “Visual exploration of an ensemble of classifiers,” Computers & graphics, vol. 85, p. 23–41, 2019. doi:https://doi.org/10.1016/j.cag.2019.08.012
  [BibTeX] [Abstract] [Download PDF]
  

  Inspecting the outputs of classification algorithms is becoming progressively difficult due to the increase in both scale and complexity of both the data and the algorithms. This has led to research efforts to develop new techniques to interpret the behavior of these algorithms and to facilitate the understanding of their results. A common classification approach is the “ensemble of classifiers”, where a set of classifiers c ∈ C is trained on the input data set and the final classification is computed by “voting”, i.e., ranking their results. One of the issues with this approach, however, is that instead of having only one classifier to analyze, now there are |C|, each with its characteristics. Thus, there is a demand for methods that provide insights into the results of an ensemble of classifiers and at the same time allow a detailed analysis of each classifier in the ensemble. Our work proposes to draw on dimensionality reduction techniques to provide visual tools to interpret the results of an ensemble of classifiers, while also giving insights into how each classifier contributes to the final results. Our approach also presents a measure of classification uncertainty by highlighting regions where there is a divergence among the classifiers in the ensemble, allowing one to focus their analysis on these regions. We tested our approach using the Digits MNIST and Fashion MNIST data sets. Through the use of maps that provide an overview of a classifier behavior to instance-based visualizations, we show how our approach can assist in the interpretation of why a specific decision (classification) was made.

  @Article{Ribeiro2019Visualexplorationensemble,
  abstract = {Inspecting the outputs of classification algorithms is becoming progressively difficult due to the increase in both scale and complexity of both the data and the algorithms. This has led to research efforts to develop new techniques to interpret the behavior of these algorithms and to facilitate the understanding of their results. A common classification approach is the “ensemble of classifiers”, where a set of classifiers c ∈ C is trained on the input data set and the final classification is computed by “voting”, i.e., ranking their results. One of the issues with this approach, however, is that instead of having only one classifier to analyze, now there are |C|, each with its characteristics. Thus, there is a demand for methods that provide insights into the results of an ensemble of classifiers and at the same time allow a detailed analysis of each classifier in the ensemble. Our work proposes to draw on dimensionality reduction techniques to provide visual tools to interpret the results of an ensemble of classifiers, while also giving insights into how each classifier contributes to the final results. Our approach also presents a measure of classification uncertainty by highlighting regions where there is a divergence among the classifiers in the ensemble, allowing one to focus their analysis on these regions. We tested our approach using the Digits MNIST and Fashion MNIST data sets. Through the use of maps that provide an overview of a classifier behavior to instance-based visualizations, we show how our approach can assist in the interpretation of why a specific decision (classification) was made.},
  author = {Paula Ceccon Ribeiro and Guilherme G. Schardong and Simone D.J. Barbosa and Clarisse Sieckenius {de Souza} and Hélio Lopes},
  journal = {Computers \& Graphics},
  pages = {23--41},
  title = {Visual exploration of an ensemble of classifiers},
  volume = {85},
  year = {2019},
  doi = {https://doi.org/10.1016/j.cag.2019.08.012},
  url = {http://www.sciencedirect.com/science/article/pii/S0097849319301402},
  issn = {0097-8493},
  keywords = {Ensemble of classifiers, Decision boundary visualization, Dimensionality reduction, Inverse projection, Visual inspection},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• L. Müller, M. S. Silveira, and C. S. de Souza, “Source code comprehension and appropriation by novice programmers: understanding novice programmers’ perception about source code reuse,” Journal on interactive systems, vol. 10, iss. 2, p. 96–109, 2019. doi:10.5753/jis.2019.556
  [BibTeX] [Abstract] [Download PDF]
  

  Software development practices rely extensively on reusing source code written by other programmers. One of the recurring questions about such practice is how much programmers, acting as users of somebody else’s code, really understand the source code that they inject it in their programs. The question is even more important for novices, who are trying to learn what programming is and how it should be practiced on a larger scale. In this paper we present the results of an ongoing research using a semiotic approach to investigate how novice programmers reuse source code, and how, through messages inscribed in the source code of the programs they write or reuse, they communicate, implicitly or explicitly, what such source code \”means\” to them and others. We carried out three studies with novice programmers, and results suggest that source code reuse may impact what programmers take their source code to mean.

  @Article{Mueller2019SourceCodeComprehension,
  abstract = {Software development practices rely extensively on reusing source code written by other programmers. One of the recurring questions about such practice is how much programmers, acting as users of somebody else’s code, really understand the source code that they inject it in their programs. The question is even more important for novices, who are trying to learn what programming is and how it should be practiced on a larger scale. In this paper we present the results of an ongoing research using a semiotic approach to investigate how novice programmers reuse source code, and how, through messages inscribed in the source code of the programs they write or reuse, they communicate, implicitly or explicitly, what such source code \"means\" to them and others. We carried out three studies with novice programmers, and results suggest that source code reuse may impact what programmers take their source code to mean.},
  author = {Luana Müller and Milene Selbach Silveira and Clarisse S. de Souza},
  journal = {Journal on Interactive Systems},
  pages = {96--109},
  title = {Source Code Comprehension and Appropriation by Novice Programmers: Understanding Novice Programmers’ Perception about Source Code Reuse},
  volume = {10},
  year = {2019},
  doi = {10.5753/jis.2019.556},
  number = {2},
  url = {https://sol.sbc.org.br/journals/index.php/jis/article/view/556},
  issn = {2236-3297},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• B. A. Chagas, D. F. Redmiles, and C. S. de Souza, “Signs of appropriation: a semiotic account of breakdowns with iot technology,” Journal on interactive systems, vol. 10, iss. 2, p. 3–19, 2019. doi:10.5753/jis.2019.550
  [BibTeX] [Abstract] [Download PDF]
  

  The Internet of Things (IOT) is an emerging technology powered by smart devices that increasingly populate our environment and transform our practices. Understanding how technologies are appropriated is a key asset for designing them successfully. In this paper, we present findings from an in situ study where we observed how people use and adapt commercially available smart home technology, in real practice, and over time. By using semiotic theory and thematic analysis to investigate data from diaries, questionnaires and interviews collected from a group of eleven participants, we characterized IoT appropriation as interpretive states that can evolve overtime. We also identified eight classes of appropriation breakdowns and derived two semiotic qualities for IoT technologies. We propose that, together, they have the potential to support productive decision making by IoT designers, as well as to raise new research questions on the topic.

  @Article{Chagas2019SignsAppropriationSemiotic,
  abstract = {The Internet of Things (IOT) is an emerging technology powered by smart devices that increasingly populate our environment and transform our practices. Understanding how technologies are appropriated is a key asset for designing them successfully. In this paper, we present findings from an in situ study where we observed how people use and adapt commercially available smart home technology, in real practice, and over time. By using semiotic theory and thematic analysis to investigate data from diaries, questionnaires and interviews collected from a group of eleven participants, we characterized IoT appropriation as interpretive states that can evolve overtime. We also identified eight classes of appropriation breakdowns and derived two semiotic qualities for IoT technologies. We propose that, together, they have the potential to support productive decision making by IoT designers, as well as to raise new research questions on the topic.},
  author = {Bruno A. Chagas and David F. Redmiles and Clarisse S. de Souza},
  journal = {Journal on Interactive Systems},
  pages = {3--19},
  title = {Signs of Appropriation: A Semiotic Account of Breakdowns with IOT Technology},
  volume = {10},
  year = {2019},
  doi = {10.5753/jis.2019.550},
  number = {2},
  url = {https://sol.sbc.org.br/journals/index.php/jis/article/view/550},
  issn = {2236-3297},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

2018

• C. S. de Souza, “A pragmatic turn in computer science,” Interactions, vol. 25, iss. 3, p. 20–21, 2018. doi:10.1145/3200147
  [BibTeX] [Abstract]
  

  In this column paper, Clarisse de Souza writes about the role that HCI could (and possibly should) play, adding a Pragmatic component to the theoretical description of formal computer languages, in the same way as Pragmatics has enriched the theoretical description of natural human languages.

  @Article{Souza2018PragmaticTurnComputer,
  abstract = {In this column paper, Clarisse de Souza writes about the role that HCI could (and possibly should) play, adding a Pragmatic component to the theoretical description of formal computer languages, in the same way as Pragmatics has enriched the theoretical description of natural human languages.},
  author = {de Souza, Clarisse Sieckenius},
  journal = {Interactions},
  pages = {20--21},
  title = {A Pragmatic Turn in Computer Science},
  volume = {25},
  year = {2018},
  doi = {10.1145/3200147},
  month = apr,
  number = {3},
  acmid = {3200147},
  address = {New York, NY, USA},
  issn = {1072-5520},
  issue_date = {May-June 2018},
  numpages = {2},
  owner = {SERG},
  publisher = {ACM},
  timestamp = {2020-10-21},
  }

• A. Lopes, U. Campos, T. Conte, and C. S. de Souza, “Comd2: family of techniques for inspecting defects in models that affect team communication,” in Proceedings of the 30th international conference on software engineering and knowledge engineering, Pittsburgh, PA, 2018, p. 298–303. doi:10.18293/SEKE2018-155
  [BibTeX] [Abstract] [Download PDF]
  

  Communication failures in software development teams can compromise the software quality. Therefore, identifying and mitigating risks for effective team communication are important activities in software development. Software models are one of the means of communication in development teams, because it communicates other members of the development team about the software. Thus, our research focuses on inspection techniques for identifying defects that affect the team communication through the software models. This paper presents a family of techniques for inspecting defects that affect team communication, called ComD2 (Communication between Designers and Developers). The ComD2 family was developed based on theories that investigate different ways of communication. For the time being, the ComD2 family has three specific inspection techniques for UML models, such as class diagrams, activity diagrams, and state machine diagrams. We performed a feasibility study and the results showed that the ComD2 family was considered useful for the identification of defects that affect the team communication through the software models.

  @InProceedings{Lopes2018ComD2FamilyTechniques,
  abstract = {Communication failures in software development teams can compromise the software quality. Therefore, identifying and mitigating risks for effective team communication are important activities in software development. Software models are one of the means of communication in development teams, because it communicates other members of the development team about the software. Thus, our research focuses on inspection techniques for identifying defects that affect the team communication through the software models. This paper presents a family of techniques for inspecting defects that affect team communication, called ComD2 (Communication between Designers and Developers). The ComD2 family was developed based on theories that investigate different ways of communication. For the time being, the ComD2 family has three specific inspection techniques for UML models, such as class diagrams, activity diagrams, and state machine diagrams. We performed a feasibility study and the results showed that the ComD2 family was considered useful for the identification of defects that affect the team communication through the software models.},
  address = {Pittsburgh, PA},
  author = {Adriana Lopes and Ursula Campos and Tayana Conte and Clarisse Sieckenius de Souza},
  booktitle = {Proceedings of the 30th International Conference on Software Engineering and Knowledge Engineering},
  editor = {Oscar Mortagua Pereira and Angelo Perkusich},
  location = {San Francisco, CA},
  pages = {298--303},
  publisher = {KSI Research Inc. and Knowledge Systems Institute Graduate School},
  title = {ComD2: Family of Techniques for Inspecting Defects in Models That Affect Team Communication},
  year = {2018},
  series = {Proceedings of the International Conference on Software Engineering and Knowledge Engineering},
  doi = {10.18293/SEKE2018-155},
  keywords = {inspection technique, communication artifact, UML diagrams, human-centered computing; software engineering;},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://ksiresearchorg.ipage.com/seke/seke18.html},
  }

• L. M. Afonso, J. A. M. D. Bastos, C. S. de Souza, and R. F. G. de Cerqueira, “The case for api communicability evaluation: introducing api-si with examples from keras,” Eprint arxiv:1808.05891, vol. 08/2018, iss. 2018arXiv180805891M, p. 1–9, 2018.
  [BibTeX] [Abstract] [Download PDF]
  

  In addition to their vital role in professional software development, Application Programming Interfaces (APIs) are now increasingly used by non-professional programmers, including end users, scientists and experts from other domains. Therefore , good APIs must meet old and new user requirements. Most of the research on API evaluation and design derives from user-centered, cognitive perspectives on human-computer interaction. As an alternative, we present a lower-threshold variant of a previously proposed semiotic API evaluation tool. We illustrate the procedures and power of this variant, called API Signification Inspection (API-SI), with Keras, a Deep Learning API. The illustration also shows how the method can complement and fertilize API usability studies. Additionally, API-SI is packaged as an introductory semiotic tool that API designers and researchers can use to evaluate the communication of design intent and product rationale to other programmers through implicit and explicit signs thereof, en- countered in the API structure, behavior and documentation.

  @Article{Afonso2018CaseAPICommunicability,
  abstract = {In addition to their vital role in professional software development, Application Programming Interfaces (APIs) are now increasingly used by non-professional programmers, including end users, scientists and experts from other domains. Therefore , good APIs must meet old and new user requirements. Most of the research on API evaluation and design derives from user-centered, cognitive perspectives on human-computer interaction. As an alternative, we present a lower-threshold variant of a previously proposed semiotic API evaluation tool. We illustrate the procedures and power of this variant, called API Signification Inspection (API-SI), with Keras, a Deep Learning API. The illustration also shows how the method can complement and fertilize API usability studies. Additionally, API-SI is packaged as an introductory semiotic tool that API designers and researchers can use to evaluate the communication of design intent and product rationale to other programmers through implicit and explicit signs thereof, en- countered in the API structure, behavior and documentation.},
  author = {Luiz Marques Afonso and João Antonio Marcondes Dutra Bastos and Clarisse Sieckenius de Souza and Renato Fontoura de Gusmão Cerqueira},
  journal = {eprint arXiv:1808.05891},
  pages = {1--9},
  title = {The Case for API Communicability Evaluation: Introducing API-SI with Examples from Keras},
  volume = {08/2018},
  year = {2018},
  number = {2018arXiv180805891M},
  url = {https://arxiv.org/abs/1808.05891},
  archiveprefix = {arxiv},
  eprint = {1808.05891},
  keywords = {Computer Science, Software Engineering, Communicability, API Evaluation, API Design, Conversational APIs, Semiotic Engineering, Keras},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• J. S. J. Ferreira, C. S. de Souza, R. R. M. de Brandão, and C. F. Leitão, “Signifyi-cdn: merged communicability and usability methods to evaluate notation-intensive interaction,” Eprint arxiv:1808.08138, vol. 08/2018, iss. arXiv:1808.08138, p. 1–12, 2018.
  [BibTeX] [Abstract] [Download PDF]
  

  We present SigniFYI-CDN, an inspection method built from previously proposed methods combining Semiotic Engineering and the Cognitive Dimensions of Notations. Compared to its predecessors, SigniFYI-CDN simplifies procedural steps and supports them with more analytic scaffolds. It is especially fit for the study of interaction with technologies where notations are created and used by various people, or by a single person in various, and potentially distant, occasions. In such cases, notations may serve several purposes, like (mutual) comprehension, recall, coordination, negotiation, and documentation. We illustrate SigniFYI-CDN with highlights from the evaluation of a computer tool that supports qualitative data analysis. Our contribution is a simpler tool for researchers and practitioners to probe the power of combined communicability and usability analysis of interaction with increasingly complex data-intensive applications.

  @Article{Ferreira2018SigniFYICDNMerged,
  abstract = {We present SigniFYI-CDN, an inspection method built from previously proposed methods combining Semiotic Engineering and the Cognitive Dimensions of Notations. Compared to its predecessors, SigniFYI-CDN simplifies procedural steps and supports them with more analytic scaffolds. It is especially fit for the study of interaction with technologies where notations are created and used by various people, or by a single person in various, and potentially distant, occasions. In such cases, notations may serve several purposes, like (mutual) comprehension, recall, coordination, negotiation, and documentation. We illustrate SigniFYI-CDN with highlights from the evaluation of a computer tool that supports qualitative data analysis. Our contribution is a simpler tool for researchers and practitioners to probe the power of combined communicability and usability analysis of interaction with increasingly complex data-intensive applications.},
  author = {Juliana Soares Jansen Ferreira and Clarisse Sieckenius de Souza and Rafael Rossi de Mello Brandão and Carla Faria Leitão},
  journal = {eprint arXiv:1808.08138},
  pages = {1--12},
  title = {SigniFYI-CDN: Merged Communicability and Usability Methods to Evaluate Notation-Intensive Interaction},
  volume = {08/2018},
  year = {2018},
  number = {arXiv:1808.08138},
  url = {https://arxiv.org/abs/1808.08138},
  archiveprefix = {arxiv},
  eprint = {1808.08138},
  keywords = {Computer Science, Human-Computer Interaction, Inspection Methods, Semiotic Engineering, Cognitive Dimensions of Notations, Notation-Intensive Interaction},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• B. A. Chagas, D. F. Redmiles, and C. S. de Souza, “Observed appropriation of iot technology: a semiotic account,” in Proceedings of the 17th brazilian symposium on human factors in computing systems, New York, NY, USA, 2018, p. 33:1–33:10. doi:10.1145/3274192.3274225
  [BibTeX] [Abstract] [Download PDF]
  

  The Internet of Things (IoT) is an emerging technology powered by smart devices that increasingly pervades our environments and practices. The process of incorporating technology into one’s practices involves use and adaptation of the technology and is usually referred to as appropriation. In research about IoT, appropriation of IoT technology is a rather new topic. It is necessary to understand how appropriation takes place in order to be able to provide strong support for it in the design of technology. In this paper, we present the initial results of an in-situ study observing how people use and adapt commercially available smart home technology, in practice, over time. We took Semiotic Engineering as a theoretical lens to understand the appropriation we observed in actual settings. Our contribution is to propose a semiotic account of appropriation and two derived qualities that can help designers address appropriation support in IoT technologies.

  @InProceedings{Chagas2018ObservedAppropriationIOT,
  abstract = {The Internet of Things (IoT) is an emerging technology powered by smart devices that increasingly pervades our environments and practices. The process of incorporating technology into one's practices involves use and adaptation of the technology and is usually referred to as appropriation. In research about IoT, appropriation of IoT technology is a rather new topic. It is necessary to understand how appropriation takes place in order to be able to provide strong support for it in the design of technology. In this paper, we present the initial results of an in-situ study observing how people use and adapt commercially available smart home technology, in practice, over time. We took Semiotic Engineering as a theoretical lens to understand the appropriation we observed in actual settings. Our contribution is to propose a semiotic account of appropriation and two derived qualities that can help designers address appropriation support in IoT technologies.},
  address = {New York, NY, USA},
  author = {Chagas, Bruno A. and Redmiles, David F. and de Souza, Clarisse S.},
  booktitle = {Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems},
  location = {Belém, Brazil},
  pages = {33:1--33:10},
  publisher = {ACM},
  title = {Observed Appropriation of IOT Technology: A Semiotic Account},
  year = {2018},
  series = {IHC 2018},
  acmid = {3274225},
  articleno = {33},
  doi = {10.1145/3274192.3274225},
  isbn = {978-1-4503-6601-4},
  keywords = {Appropriation, Internet of Things, Semiotic Engineering},
  numpages = {10},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {https://doi.org/10.1145/3274192.3274225},
  }

• L. Müller, M. S. Silveira, and C. S. de Souza, “Do i know what my code is “saying”?: a study on novice programmers’ perceptions of what reused source code may mean,” in Proceedings of the 17th brazilian symposium on human factors in computing systems, New York, NY, USA, 2018, p. 17:1–17:10. doi:10.1145/3274192.3274209
  [BibTeX] [Abstract] [Download PDF]
  

  Software development practices rely extensively on reusing source code written by other programmers. One of the recurring questions about such practice is how much programmers, acting as users of somebody else’s code, really understand about the source code that they inject it in their own programs. The question is even more important for novices, who are trying to learn what programming is and how it should be practiced in larger scale. In this paper we present the results of an ongoing research using a semiotic approach to investigate how programmers send and receive, through messages inscribed in the source code of the programs they write or reuse, implicit and explicit communication about what such source code “means” to them and others. We carried out two studies with novice programmers and results suggest that source code reuse may impact the comprehension that programmers have about their own source code. In addition, how it impacts their understanding about the messages that are being communicated through their programs.

  @InProceedings{Mueller2018DoIKnow,
  abstract = {Software development practices rely extensively on reusing source code written by other programmers. One of the recurring questions about such practice is how much programmers, acting as users of somebody else's code, really understand about the source code that they inject it in their own programs. The question is even more important for novices, who are trying to learn what programming is and how it should be practiced in larger scale. In this paper we present the results of an ongoing research using a semiotic approach to investigate how programmers send and receive, through messages inscribed in the source code of the programs they write or reuse, implicit and explicit communication about what such source code "means" to them and others. We carried out two studies with novice programmers and results suggest that source code reuse may impact the comprehension that programmers have about their own source code. In addition, how it impacts their understanding about the messages that are being communicated through their programs.},
  address = {New York, NY, USA},
  author = {Müller, Luana and Silveira, Milene Selbach and de Souza, Clarisse Sieckenius},
  booktitle = {Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems},
  location = {Belém, Brazil},
  pages = {17:1--17:10},
  publisher = {ACM},
  title = {Do I Know What My Code Is "Saying"?: A Study on Novice Programmers' Perceptions of What Reused Source Code May Mean},
  year = {2018},
  series = {IHC 2018},
  acmid = {3274209},
  articleno = {17},
  doi = {10.1145/3274192.3274209},
  isbn = {978-1-4503-6601-4},
  keywords = {Semiotic Engineering, Source code reuse, metacommunication, novice programmers},
  numpages = {10},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {https://doi.org/10.1145/3274192.3274209},
  }

• J. L. Carbonera, B. N. Gonçalves, and C. S. de Souza, “O problema da explicação em inteligência artificial: considerações a partir da semiótica,” Teccogs: revista digital de tecnologias cognitivas, vol. 17, p. 59–75, 2018.
  [BibTeX] [Abstract] [Download PDF]
  

  Since the expert systems of the 1980s and 1990s, Artificial Intelligence (AI) researchers have tried to solve the the problem of explanation, namely, given an inference from the system, how to identify the steps or mechanisms that have led to the conclusion. With the recent success of AI systems, especially those based on deep learning, this problem has come to the fore again more forcefully since the processesare opaque as far as their inferences are concerned, in contrast to expert systems, which are based on logical rules. In this text, we present the problem of explanation, including highlights from its most recent literature in the area of AI. Next, we indicate gaps in past and recent approaches, and then present considerations from Peirce’s semiotics, which, as we argue, could contribute to a balanced management of this technology in society.

  @Article{Carbonera2018OProblemada,
  abstract = {Since the expert systems of the 1980s and 1990s, Artificial Intelligence (AI) researchers have tried to solve the the problem of explanation, namely, given an inference from the system, how to identify the steps or mechanisms that have led to the conclusion. With the recent success of AI systems, especially those based on deep learning, this problem has come to the fore again more forcefully since the processesare opaque as far as their inferences are concerned, in contrast to expert systems, which are based on logical rules. In this text, we present the problem of explanation, including highlights from its most recent literature in the area of AI. Next, we indicate gaps in past and recent approaches, and then present considerations from Peirce's semiotics, which, as we argue, could contribute to a balanced management of this technology in society.},
  author = {Joel L. Carbonera and Bernardo N. Gonçalves and Clarisse S. de Souza},
  journal = {TECCOGS: REVISTA DIGITAL DE TECNOLOGIAS COGNITIVAS},
  pages = {59--75},
  title = {O Problema da Explicação em Inteligência Artificial: Considerações a Partir da Semiótica},
  volume = {17},
  year = {2018},
  url = {https://www.pucsp.br/pos/tidd/teccogs/artigos/2018/edicao_17/teccogs17_artigo03.pdf},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

2017

• I. T. Monteiro, L. C. C. de Salgado, M. P. Mota, A. L. Sampaio, and C. S. de Souza, “Signifying software engineering to computational thinking learners with agentsheets and polifacets,” Journal of visual languages & computing, vol. 40, p. 91–112, 2017. doi:10.1016/j.jvlc.2017.01.005
  [BibTeX] [Abstract] [Download PDF]
  

  Abstract Nonprofessional end user programs have increased remarkably in volume and diversity. However, for such programs to be usable and reliable, their creators should be familiar with software engineering practices that are typically not part of their range of competence and source of enjoyment. While the expansion of computational thinking acquisition (CTA) initiatives at schools and the availability of improved programming environments have contributed to facilitate the learners{\’} coding tasks, much less has been done to facilitate the acquisition of software quality notions. This paper reports on a Brazilian \{CTA\} program guided by semiotic principles and describes a study of how the technology used in it prefigures elements of software engineering in the participants{\’} programs created with AgentSheets. Our research contributions touch on the semiotic potential of \{CTA\} infrastructures and on associated pedagogical considerations for expanding \{CTA\} programs with software engineering basics. We also propose items for an interdisciplinary research agenda.

  @Article{Monteiro2017SignifyingSoftwareEngineering,
  abstract = {Abstract Nonprofessional end user programs have increased remarkably in volume and diversity. However, for such programs to be usable and reliable, their creators should be familiar with software engineering practices that are typically not part of their range of competence and source of enjoyment. While the expansion of computational thinking acquisition (CTA) initiatives at schools and the availability of improved programming environments have contributed to facilitate the learners{\'} coding tasks, much less has been done to facilitate the acquisition of software quality notions. This paper reports on a Brazilian \{CTA\} program guided by semiotic principles and describes a study of how the technology used in it prefigures elements of software engineering in the participants{\'} programs created with AgentSheets. Our research contributions touch on the semiotic potential of \{CTA\} infrastructures and on associated pedagogical considerations for expanding \{CTA\} programs with software engineering basics. We also propose items for an interdisciplinary research agenda.},
  author = {Ingrid Teixeira Monteiro and Luciana Cardoso de Castro Salgado and Marcelle Pereira Mota and Andréia Libório Sampaio and Clarisse Sieckenius de Souza},
  journal = {Journal of Visual Languages \& Computing},
  pages = {91--112},
  title = {Signifying Software Engineering to Computational Thinking Learners with Agentsheets and Polifacets},
  volume = {40},
  year = {2017},
  doi = {10.1016/j.jvlc.2017.01.005},
  url = {http://www.sciencedirect.com/science/article/pii/S1045926X16300234},
  issn = {1045-926X},
  keywords = {Computational thinking acquisition (CTA), AgentSheets, Program deconstructions, End User Software Engineering (EUSE), Semiotic analysis, Semiotic Engineering, End user development (EUD)},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, “Semiotics and human-computer interaction,” in The wiley handbook of human computer interaction, John wiley & sons, ltd, 2017, p. 33–49. doi:10.1002/9781118976005.ch2
  [BibTeX] [Abstract]
  

  Summary This chapter presents a broad-brush picture of what Semiotics is and how it can contribute to advance HCI research and practice. Content and references privilege clarity and cohesion of presentation, rather than coverage of existing work. It begins with a concrete example of user-system interaction from which the author extracts the elements to introduce some fundamental concepts in semiotic theories and show how they can be applied to HCI. The chapter also includes an overview of work done to date in this interdisciplinary field, as well as a final commentary on potential avenues for future research.

  @InBook{Souza2017SemioticsHumanComputer,
  author = {de Souza, Clarisse Sieckenius},
  booktitle = {The Wiley Handbook of Human Computer Interaction},
  pages = {33--49},
  publisher = {John Wiley \& Sons, Ltd},
  title = {Semiotics and Human-Computer Interaction},
  year = {2017},
  abstract = {Summary This chapter presents a broad-brush picture of what Semiotics is and how it can contribute to advance HCI research and practice. Content and references privilege clarity and cohesion of presentation, rather than coverage of existing work. It begins with a concrete example of user-system interaction from which the author extracts the elements to introduce some fundamental concepts in semiotic theories and show how they can be applied to HCI. The chapter also includes an overview of work done to date in this interdisciplinary field, as well as a final commentary on potential avenues for future research.},
  chapter = {2},
  doi = {10.1002/9781118976005.ch2},
  eprint = {https://onlinelibrary.wiley.com/doi/pdf/10.1002/9781118976005.ch2},
  isbn = {9781118976005},
  keywords = {Semiotics, computer-mediated human communication, metacommunication through digital proxies},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, “Semiotic engineering: a cohering theory to connect eud with hci, cmc and more,” in New perspectives in end-user development, F. Paternò and V. Wulf, Eds., Cham: Springer international publishing, 2017, p. 269–305. doi:10.1007/978-3-319-60291-2_11
  [BibTeX] [Abstract]
  

  Theories have an important role to play in research areas whose application faces rapid technological changes. They can provide longer-term intellectual references that shape deeper investigations and contribute to consolidate the identity of such research areas. A recent survey of EUD-related work published between 2004 and 2013 suggests that our field is remarkably techno-centered and could increase its scientific impact by diversifying some of its research approaches and practices. In this paper we show concrete examples of how Semiotic Engineering, originally a semiotic theory of human-computer interaction, can provide a unified theoretical framing for various EUD-related topics of investigation. Our contribution to the collection of chapters in this book is to demonstrate this particular theory{\’}s potential as a catalyst of new kinds of transdisciplinary debate, as well as a source of inspiration for new breeds of technological developments.

  @InBook{Souza2017SemioticEngineeringCohering,
  address = {Cham},
  author = {de Souza, Clarisse Sieckenius},
  booktitle = {New Perspectives in End-User Development},
  editor = {Paternò, Fabio and Wulf, Volker},
  pages = {269--305},
  publisher = {Springer International Publishing},
  title = {Semiotic Engineering: A Cohering Theory to Connect EUD with HCI, CMC and More},
  year = {2017},
  abstract = {Theories have an important role to play in research areas whose application faces rapid technological changes. They can provide longer-term intellectual references that shape deeper investigations and contribute to consolidate the identity of such research areas. A recent survey of EUD-related work published between 2004 and 2013 suggests that our field is remarkably techno-centered and could increase its scientific impact by diversifying some of its research approaches and practices. In this paper we show concrete examples of how Semiotic Engineering, originally a semiotic theory of human-computer interaction, can provide a unified theoretical framing for various EUD-related topics of investigation. Our contribution to the collection of chapters in this book is to demonstrate this particular theory{\'}s potential as a catalyst of new kinds of transdisciplinary debate, as well as a source of inspiration for new breeds of technological developments.},
  doi = {10.1007/978-3-319-60291-2_11},
  isbn = {978-3-319-60291-2},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• J. A. D. M. Bastos, L. M. Afonso, and C. S. de Souza, “Metacommunication between programmers through an application programming interface: a semiotic analysis of date and time apis,” in 2017 ieee symposium on visual languages and human-centric computing (vl/hcc), 2017, p. 213–221. doi:10.1109/VLHCC.2017.8103470
  [BibTeX] [Abstract]
  

  When programmers use an API, they play the role of a {\”}software user{\”}. As the quality of use of programs and systems affects productivity, more attention has been paid to API usability issues. This work focuses on another dimension of the quality of use, {\”}communicability{\”}, which is characteristic of a semiotic approach. The paper presents a Semiotic Engineering study on the communicability of APIs. We analyzed metacommunication – a central concept of the theory we use – between designers and users of date APIs, specifically, using the {\”}SigniFYIng APIs{\”} method. The results of the analysis were then related to the testimony of professional programmers during an interview concerning their experience with APIs and programming in general. We illustrate and discuss the value of the results achieved with our API communicability analysis, which in our view is a promising addition to research initiatives that have been exploring API usability.

  @InProceedings{Bastos2017MetacommunicationProgrammersApplication,
  abstract = {When programmers use an API, they play the role of a {\"}software user{\"}. As the quality of use of programs and systems affects productivity, more attention has been paid to API usability issues. This work focuses on another dimension of the quality of use, {\"}communicability{\"}, which is characteristic of a semiotic approach. The paper presents a Semiotic Engineering study on the communicability of APIs. We analyzed metacommunication - a central concept of the theory we use - between designers and users of date APIs, specifically, using the {\"}SigniFYIng APIs{\"} method. The results of the analysis were then related to the testimony of professional programmers during an interview concerning their experience with APIs and programming in general. We illustrate and discuss the value of the results achieved with our API communicability analysis, which in our view is a promising addition to research initiatives that have been exploring API usability.},
  author = {J. A. D. M. Bastos and L. M. Afonso and C.S. de Souza},
  booktitle = {2017 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)},
  pages = {213--221},
  title = {Metacommunication between Programmers through an Application Programming Interface: A Semiotic Analysis of Date and Time APIs},
  year = {2017},
  month = oct,
  doi = {10.1109/VLHCC.2017.8103470},
  keywords = {application program interfaces;programming;API communicability analysis;API usability issues;SigniFYIng APIs method;application programming interface;metacommunication;professional programmers;semiotic analysis;semiotic approach;semiotic engineering study;software user;Human computer interaction;Interviews;Programming;Semiotics;Usability;Visualization;SigniFYIng APIs;application programming interface;communicability;human-centered computing;semiotic engineering},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• B. A. Chagas, D. F. Redmiles, and C. S. de Souza, “End-user development for the internet of things or how can a (smart) light bulb be so complicated?,” in 2017 ieee symposium on visual languages and human-centric computing (vl/hcc), 2017, p. 273–277. doi:10.1109/VLHCC.2017.8103478
  [BibTeX] [Abstract]
  

  End-User Development (EUD) has been identified as one approach to address some of the challenges of the Internet of Things (IoT) by enabling people to configure technology to their specific needs and preferences. For this potential to be realized, end-users need appropriate tools to support them and, in order to build such tools, developers need a deeper understanding of what EUD for IoT really means. This paper proposes a framing for EUD for IoT based on semiotic engineering theory for human-centered computing (HCC) and explores how this framing can be used with a concrete example of existing technology. Our contribution is to present a new way of framing research questions in this area, which we illustrate with a brief example.

  @InProceedings{Chagas2017EndUserDevelopment,
  abstract = {End-User Development (EUD) has been identified as one approach to address some of the challenges of the Internet of Things (IoT) by enabling people to configure technology to their specific needs and preferences. For this potential to be realized, end-users need appropriate tools to support them and, in order to build such tools, developers need a deeper understanding of what EUD for IoT really means. This paper proposes a framing for EUD for IoT based on semiotic engineering theory for human-centered computing (HCC) and explores how this framing can be used with a concrete example of existing technology. Our contribution is to present a new way of framing research questions in this area, which we illustrate with a brief example.},
  author = {B. A. Chagas and D. F. Redmiles and C.S. de Souza},
  booktitle = {2017 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)},
  pages = {273--277},
  title = {End-User Development for the Internet of Things or How Can a (Smart) Light Bulb Be so Complicated?},
  year = {2017},
  month = oct,
  doi = {10.1109/VLHCC.2017.8103478},
  keywords = {Internet of Things;human computer interaction;software engineering;EUD;HCC;Internet of Things;IoT;end-user development;human-centered computing;semiotic engineering theory;smart light bulb;Ecosystems;Human computer interaction;Intelligent sensors;Semiotics;Software;Tools;end-user development;internet of things;semiotic engineering},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• A. Lopes, T. Conte, and C. S. de Souza, “Analyzing the use case communicability,” in Proceedings of the xvi brazilian symposium on human factors in computing systems, New York, NY, USA, 2017, p. 13:1–13:10. doi:10.1145/3160504.3160539
  [BibTeX] [Abstract]
  

  Software artifacts are products created during software development. Through them, designers communicate their intent and understanding of a system to other members of the development team. And the intent will, in the end, be communicated to end users through the system{\’}s interface. In this paper, we present a study about forms of expression for the informational content of use cases, and how they can affect mutual understanding among members of a software development team. We adopted the Semiotic Engineering perspective (in particular, the SigniFYIng Message tool) and the maxims of the Grice{\’}s Cooperative Principle to structure and analyze data collected from 17 pairs of participants. The results show evidence of communication strategies that may impair the communication between designers and developers and, subsequently, the metacommunication of design intent to end users through the system{\’}s interface.

  @InProceedings{Lopes2017AnalyzingUseCase,
  abstract = {Software artifacts are products created during software development. Through them, designers communicate their intent and understanding of a system to other members of the development team. And the intent will, in the end, be communicated to end users through the system{\’}s interface. In this paper, we present a study about forms of expression for the informational content of use cases, and how they can affect mutual understanding among members of a software development team. We adopted the Semiotic Engineering perspective (in particular, the SigniFYIng Message tool) and the maxims of the Grice{\'}s Cooperative Principle to structure and analyze data collected from 17 pairs of participants. The results show evidence of communication strategies that may impair the communication between designers and developers and, subsequently, the metacommunication of design intent to end users through the system{\'}s interface.},
  address = {New York, NY, USA},
  author = {Lopes, Adriana and Conte, Tayana and de Souza, Clarisse Sieckenius},
  booktitle = {Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems},
  location = {Joinville, Brazil},
  pages = {13:1--13:10},
  publisher = {ACM},
  title = {Analyzing the Use Case Communicability},
  year = {2017},
  series = {IHC 2017},
  acmid = {3160539},
  articleno = {13},
  doi = {10.1145/3160504.3160539},
  isbn = {978-1-4503-6377-8},
  keywords = {Communicability, SigniFYI, UML models, Use Cases, artifacts, semiotic engineering},
  numpages = {10},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• R. O. Prates, M. B. Rosson, and C. S. de Souza, “Analyzing the communicability of configuration decision space over time in collaborative systems through a case study,” Sbc journal on interactive systems – jis, vol. 8, iss. 2, p. 15, 2017.
  [BibTeX] [Abstract] [Download PDF]
  

  Some configuration settings have immediate impact on system state; others have impact over time. In collaborative systems, the timeline of impacts can be even more complex, because changes may impact not only the user who made them but also other users. In this paper, we analyze the challenges involved in specifying configuration in collaborative systems that have impact over time. To do so, we have chosen Google Inactive Account Manager (IAM) as a case study, since it offers a limited set of decisions, but that addresses different aspects that are relevant to future impact configuration. In order to generate a thorough and systematic analysis of the communicability of Google IAM{\’}s decision space we used the Semiotic Inspection Method (SIM) and the Configurable Interaction Anticipation Challenges (CIAC), as well as the Modeling Language for Interactive Collaborative Conversations (MoLICC). Our results describe and explain some of the main issues associated to the complexity of decisions that users may take in during a configuration task.

  @Article{Prates2017AnalyzingCommunicabilityConfiguration,
  abstract = {Some configuration settings have immediate impact on system state; others have impact over time. In collaborative systems, the timeline of impacts can be even more complex, because changes may impact not only the user who made them but also other users. In this paper, we analyze the challenges involved in specifying configuration in collaborative systems that have impact over time. To do so, we have chosen Google Inactive Account Manager (IAM) as a case study, since it offers a limited set of decisions, but that addresses different aspects that are relevant to future impact configuration. In order to generate a thorough and systematic analysis of the communicability of Google IAM{\'}s decision space we used the Semiotic Inspection Method (SIM) and the Configurable Interaction Anticipation Challenges (CIAC), as well as the Modeling Language for Interactive Collaborative Conversations (MoLICC). Our results describe and explain some of the main issues associated to the complexity of decisions that users may take in during a configuration task.},
  author = {Raquel Oliveira Prates and Mary Beth Rosson and Clarisse Sieckenius de Souza},
  journal = {SBC Journal on Interactive Systems - JIS},
  pages = {15},
  title = {Analyzing the Communicability of Configuration Decision Space over Time in Collaborative Systems through a Case Study},
  volume = {8},
  year = {2017},
  number = {2},
  url = {http://www.seer.ufrgs.br/jis/article/view/73192},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

2016

• L. C. C. de Salgado, C. S. de Souza, C. M. D. Ferreira, and C. F. Leitão, “Characterizing intercultural encounters in human-computer interaction,” in Cross-cultural design: 8th international conference, ccd 2016, held as part of hci international 2016, toronto, on, canada, july 17-22, 2016, proceedings, Cham, Switzerland, 2016, p. 108–119. doi:10.1007/978-3-319-40093-8_12
  [BibTeX] [Abstract]
  

  This article presents a two-step study, which is part of a project that aims at investigating how cross-cultural systems, intentionally or not, express and promote indirect intercultural encounters in Human-Computer Interaction. Previous research have proposed five Cultural Viewpoint Metaphors, a Semiotic Engineering conceptual tool to support HCI designers to understand and organize communicative strategies in the interactive discourse to promote such encounters. At this stage of our research we investigated the design of cross-cultural systems using CVM and one of the best known among numerous classes of signs proposed by Peirce – icons, indices and symbols, aiming at supporting the semiotic engineering (specifically, the choice of signs, i.e. the interface elements) of these kind of applications. Our findings point at the power of an alignment of the semiotic characteristics of Cultural Viewpoint Metaphors with theoretical semiotic elements from Peirce{\’}s typology of signs in the interaction design cycle of cross-cultural systems.

  @InProceedings{Salgado2016CharacterizingInterculturalEncounters,
  abstract = {This article presents a two-step study, which is part of a project that aims at investigating how cross-cultural systems, intentionally or not, express and promote indirect intercultural encounters in Human-Computer Interaction. Previous research have proposed five Cultural Viewpoint Metaphors, a Semiotic Engineering conceptual tool to support HCI designers to understand and organize communicative strategies in the interactive discourse to promote such encounters. At this stage of our research we investigated the design of cross-cultural systems using CVM and one of the best known among numerous classes of signs proposed by Peirce -- icons, indices and symbols, aiming at supporting the semiotic engineering (specifically, the choice of signs, i.e. the interface elements) of these kind of applications. Our findings point at the power of an alignment of the semiotic characteristics of Cultural Viewpoint Metaphors with theoretical semiotic elements from Peirce{\'}s typology of signs in the interaction design cycle of cross-cultural systems.},
  address = {Cham, Switzerland},
  author = {Salgado, Luciana C. de C. and de Souza, Clarisse Sieckenius and Ferreira, Catia M. D. and Leitão, Carla Faria},
  booktitle = {Cross-Cultural Design: 8th International Conference, CCD 2016, Held as Part of HCI International 2016, Toronto, ON, Canada, July 17-22, 2016, Proceedings},
  editor = {Rau, Patrick Pei-Luen},
  pages = {108--119},
  publisher = {Springer International Publishing},
  title = {Characterizing Intercultural Encounters in Human-Computer Interaction},
  year = {2016},
  series = {Lecture Notes in Computer Science},
  volume = {LNCS 9741},
  doi = {10.1007/978-3-319-40093-8_12},
  isbn = {978-3-319-40093-8},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, R. F. G. Cerqueira, L. M. Afonso, R. R. M. Brandão, and J. S. J. Ferreira, Software developers as users. semiotic investigations in human-centered software development, 1 ed., London: Springer international publishing, 2016. doi:10.1007/978-3-319-42831-4
  [BibTeX] [Abstract] [Download PDF]
  

  This book presents the SigniFYI Suite of conceptual and methodological tools, designed to uncover meanings inscribed in software, their origins, intent and consequences to identify and trace correlating patterns; from software design and development to software use and experience. Based on the study of Semiotic Engineering, the book advances the e study of Human-Centered Computing (HCC), inviting professionals, researchers, teachers and students to reflect upon how subjective and cultural values manifest themselves through software models, programs and user interfaces. The authors weave a mesh of technical, theoretical and philosophical considerations of what it means to build and use software, exploring what we (professionals and non-professionals) mean by the pieces of software we design and develop, as well as what pieces of software mean to end-users and others. Explicitly dedicated to software designers, developers and users, Software Developers as Users is a provocative view of socio-technical communication in the digital age.

  @Book{Souza2016SoftwareDevelopersas,
  address = {London},
  author = {Clarisse S. de Souza and Renato F. G. Cerqueira and Luiz M. Afonso and Rafael R. M. Brandão and Juliana S. J. Ferreira},
  publisher = {Springer International Publishing},
  title = {Software Developers as Users. Semiotic Investigations in Human-Centered Software Development},
  year = {2016},
  abstract = {This book presents the SigniFYI Suite of conceptual and methodological tools, designed to uncover meanings inscribed in software, their origins, intent and consequences to identify and trace correlating patterns; from software design and development to software use and experience. Based on the study of Semiotic Engineering, the book advances the e study of Human-Centered Computing (HCC), inviting professionals, researchers, teachers and students to reflect upon how subjective and cultural values manifest themselves through software models, programs and user interfaces. The authors weave a mesh of technical, theoretical and philosophical considerations of what it means to build and use software, exploring what we (professionals and non-professionals) mean by the pieces of software we design and develop, as well as what pieces of software mean to end-users and others. Explicitly dedicated to software designers, developers and users, Software Developers as Users is a provocative view of socio-technical communication in the digital age.},
  edition = {1},
  doi = {10.1007/978-3-319-42831-4},
  language = {EN},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://www.springer.com/us/book/9783319428291},
  }

• R. O. Prates, M. B. Rosson, and C. S. de Souza, “Analysis of configuration decision space over time: the google inactive manager account case,” in Xv simpósio brasileiro sobre fatores humanos em sistemas computacionais (proceedings), 2016, p. 10 p.
  [BibTeX] [Abstract] [Download PDF]
  

  Some configuration settings have immediate impact on system state; others have impact over time. In group systems, the timeline of impacts can be even more complex, because change s may impact not only the user who made them but also other users. When a system is designed, its designers plan what configuration settings to provide users with, as well as how these settings will affect the system and when. They must also help users ant icipate how these settings impact the available interactive paths over time, so that users can make informed decisions about their settings. In this paper we show how two analytical tools – the Semiotic Inspection Method (SIM) and the Configurable Interaction Anticipation Challenges (CIAC) – can be combined to probe the complexity of decisions that users may take in during a configuration task. We take Google Inactive Account Manager as our case, since all the decisions involved relate to future effects.

  @InProceedings{Prates2016AnalysisConfigurationDecision,
  abstract = {Some configuration settings have immediate impact on system state; others have impact over time. In group systems, the timeline of impacts can be even more complex, because change s may impact not only the user who made them but also other users. When a system is designed, its designers plan what configuration settings to provide users with, as well as how these settings will affect the system and when. They must also help users ant icipate how these settings impact the available interactive paths over time, so that users can make informed decisions about their settings. In this paper we show how two analytical tools - the Semiotic Inspection Method (SIM) and the Configurable Interaction Anticipation Challenges (CIAC) - can be combined to probe the complexity of decisions that users may take in during a configuration task. We take Google Inactive Account Manager as our case, since all the decisions involved relate to future effects.},
  author = {Prates, R. O. and Rosson, M. B. and de Souza, C.S.},
  booktitle = {XV Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais (Proceedings)},
  editor = {V. F. de Santana and J. S. J. Ferreira and L. C. C. Salgado and P. T.Aquino Jr},
  pages = {10 p},
  publisher = {Sociedade Brasileira de Computação},
  title = {Analysis of Configuration Decision Space Over Time: The Google Inactive Manager Account Case},
  year = {2016},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://www-di.inf.puc-rio.br/~clarisse//docs/Prates2016.pdf},
  }

2015

• S. Bødker, O. W. Bertelsen, L. Bannon, C. de Souza, S. Barbosa, and R. Prates, “Mediation and meaning in hci,” in Human-computer interaction – interact 2015: 15th ifip tc 13 international conference, bamberg, germany, september 14-18, 2015, proceedings, part iv, Cham, 2015, p. 667–668. doi:10.1007/978-3-319-22723-8_93
  [BibTeX] [Abstract]
  

  This workshop is about computer mediation in human communication and action. The proponents all look at mediation from different angles, but share the view that meaning is what mediation is about. We aim to dig beneath the surface and touch on the conception, construction, negotiation and evolution of meaning in and of technology, for producers and consumers, before and after technology is deployed. Mediation and meaning will thus allow us to discuss how different segments and perspectives in HCI research can be brought together to give us new insights about how people interact with technology.

  @InProceedings{Boedker2015MediationMeaningHCI,
  abstract = {This workshop is about computer mediation in human communication and action. The proponents all look at mediation from different angles, but share the view that meaning is what mediation is about. We aim to dig beneath the surface and touch on the conception, construction, negotiation and evolution of meaning in and of technology, for producers and consumers, before and after technology is deployed. Mediation and meaning will thus allow us to discuss how different segments and perspectives in HCI research can be brought together to give us new insights about how people interact with technology.},
  address = {Cham},
  author = {Bødker, Susanne and Bertelsen, Olav W. and Bannon, Liam and de Souza, Clarisse and Barbosa, Simone and Prates, Raquel},
  booktitle = {Human-Computer Interaction – INTERACT 2015: 15th IFIP TC 13 International Conference, Bamberg, Germany, September 14-18, 2015, Proceedings, Part IV},
  editor = {Abascal, Julio and Barbosa, Simone and Fetter, Mirko and Gross, Tom and Palanque, Philippe and Winckler, Marco},
  location = {Bamberg},
  pages = {667--668},
  publisher = {Springer International Publishing},
  title = {Mediation and Meaning in HCI},
  year = {2015},
  doi = {10.1007/978-3-319-22723-8_93},
  isbn = {978-3-319-22723-8},
  owner = {SERG},
  qualityassured = {qualityAssured},
  timestamp = {2020-10-21},
  }

• B. A. Chagas, H. Fuks, and C. S. de Souza, “Lessons learned in the design of configurable assistive technology with smart devices,” in End-user development. proceedings of 5th international symposium, is-eud 2015, Cham, Switzerland, 2015, p. 180–185. doi:10.1007/978-3-319-18425-8_13
  [BibTeX] [Abstract]
  

  Assistive Technology (AT) aims at compensating for motor, sensory or cognitive functional limitations of its users. We report on a study with a single tetraplegic participant using AT that we have been developing for interaction with multiple devices in smart connected environments. We wanted to investigate a user{\’}s reaction during his first encounter with this technology and to verify if needs and opportunities for AT configuration would emerge from study activities and interviews. Results show implicit and explicit configuration needs and opportunities suggesting that we must address both hardware and software configuration, some to be done by the end user, others by assistants. At this initial stage our contribution is to propose a structure for organizing the AT configuration problem space in order to support the design of similar technologies.

  @InProceedings{Chagas2015LessonsLearnedDesign,
  abstract = {Assistive Technology (AT) aims at compensating for motor, sensory or cognitive functional limitations of its users. We report on a study with a single tetraplegic participant using AT that we have been developing for interaction with multiple devices in smart connected environments. We wanted to investigate a user{\'}s reaction during his first encounter with this technology and to verify if needs and opportunities for AT configuration would emerge from study activities and interviews. Results show implicit and explicit configuration needs and opportunities suggesting that we must address both hardware and software configuration, some to be done by the end user, others by assistants. At this initial stage our contribution is to propose a structure for organizing the AT configuration problem space in order to support the design of similar technologies.},
  address = {Cham, Switzerland},
  author = {Chagas, B. A. and Fuks, H. and de Souza, C.S.},
  booktitle = {End-User Development. Proceedings of 5th International Symposium, IS-EUD 2015},
  location = {Madrid, Spain, May 26-29, 2015},
  pages = {180--185},
  publisher = {Springer International Publishing},
  title = {Lessons Learned in the Design of Configurable Assistive Technology with Smart Devices},
  year = {2015},
  series = {Lecture Notes in Computer Science},
  volume = {9083},
  doi = {10.1007/978-3-319-18425-8_13},
  isbn = {9783319184241},
  issn = {16113349 03029743},
  keywords = {Assistive Technology,Configuration,Wearable computers},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• J. J. Ferreira, C. S. de Souza, and R. Cerqueira, “Why and how to investigate interaction design of software development tools,” Sbc journal on interactive systems, vol. 6, iss. 1, p. 48–65, 2015.
  [BibTeX] [Abstract] [Download PDF]
  

  The existence of some relationship between the usability of software development tools and the quality of end users{\’} interaction with the product these tools contribute to build would not be surprising. Should this be the case, a developer{\’}s problematic use experience with these tools would increase the workload of HCI experts, whose aim is to promote high quality user experience with software products. Yet, this connection has not deserved much attention from researchers, and it is unclear how investigations should be conducted to verify if it is true. Our contribution in this paper is a first step in this direction. We propose an inspection method to characterize communicability and usability aspects of software modeling tools. By combining both aspects and articulating our analysis around tool, notations and people, we provide valuable conceptual links that, we argue, may in the long run of subsequent research contribute significantly to verify the (extent of the) relation between HCI quality of development tools and developed products.

  @Article{Ferreira2015WhyHowInvestigate,
  abstract = {The existence of some relationship between the usability of software development tools and the quality of end users{\'} interaction with the product these tools contribute to build would not be surprising. Should this be the case, a developer{\'}s problematic use experience with these tools would increase the workload of HCI experts, whose aim is to promote high quality user experience with software products. Yet, this connection has not deserved much attention from researchers, and it is unclear how investigations should be conducted to verify if it is true. Our contribution in this paper is a first step in this direction. We propose an inspection method to characterize communicability and usability aspects of software modeling tools. By combining both aspects and articulating our analysis around tool, notations and people, we provide valuable conceptual links that, we argue, may in the long run of subsequent research contribute significantly to verify the (extent of the) relation between HCI quality of development tools and developed products.},
  author = {Ferreira, Juliana Jansen and de Souza, Clarisse Sieckenius and Cerqueira, Renato},
  journal = {SBC Journal on Interactive Systems},
  pages = {48--65},
  title = {Why and How to Investigate Interaction Design of Software Development Tools},
  volume = {6},
  year = {2015},
  number = {1},
  url = {http://www.seer.ufrgs.br/jis/article/view/55492/0},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• I. T. Monteiro, C. S. de Souza, and E. T. Tolmasquim, “My program, my world: insights from 1st-person reflective programming in eud education,” in End-user development. proceedings of 5th international symposium, is-eud 2015, Cham, Switzerland, 2015, p. 76–91. doi:10.1007/978-3-319-18425-8_6
  [BibTeX] [Abstract]
  

  An important factor underlying the entire EUD enterprise is how to incorporate basic computer programming in school curricula. Rapidly increasing initiatives towards this goal have typically explored two kinds of abilities associated with learning how to program: logical problem solving and digital (multimedia) storytelling. In this paper we report on an exploratory qualitative study with a group of middle school children from a one-semester computational thinking acquisition class. We combined three technologies with which participants: (i) created a game; (ii) explored the representation of implicit and explicit meanings in their game; and (iii) created a scripted asynchronous Webbased conversation with their teacher about their game. We concluded that this combination can not only introduce new forms of 1st-person expression through software in basic education, but also and more importantly give teachers and learners a lead into program reflection, one of the most powerful concepts in programming and computing

  @InProceedings{Monteiro2015MyProgramMy,
  abstract = {An important factor underlying the entire EUD enterprise is how to incorporate basic computer programming in school curricula. Rapidly increasing initiatives towards this goal have typically explored two kinds of abilities associated with learning how to program: logical problem solving and digital (multimedia) storytelling. In this paper we report on an exploratory qualitative study with a group of middle school children from a one-semester computational thinking acquisition class. We combined three technologies with which participants: (i) created a game; (ii) explored the representation of implicit and explicit meanings in their game; and (iii) created a scripted asynchronous Webbased conversation with their teacher about their game. We concluded that this combination can not only introduce new forms of 1st-person expression through software in basic education, but also and more importantly give teachers and learners a lead into program reflection, one of the most powerful concepts in programming and computing},
  address = {Cham, Switzerland},
  author = {Monteiro, I. T. and de Souza, C.S. and Tolmasquim, E. T.},
  booktitle = {End-User Development. Proceedings of 5th International Symposium, IS-EUD 2015},
  location = {Madrid, Spain, May 26-29, 2015},
  pages = {76--91},
  publisher = {Springer International Publishing},
  title = {My Program, My World: Insights from 1st-person Reflective Programming in EUD Education},
  year = {2015},
  series = {Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)},
  volume = {9083},
  doi = {10.1007/978-3-319-18425-8_6},
  isbn = {9783319184241},
  issn = {16113349 03029743},
  keywords = {Computational thinking acquisition,Programming as selfexpression,Reflective computing},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• R. O. Prates, M. B. Rosson, and C. S. de Souza, “Making decisions about digital legacy with google\’s inactive account manager,” in Human-computer interaction – interact 2015, Cham, Switzerland, 2015, p. 201–209. doi:10.1007/978-3-319-22701-6_14
  [BibTeX] [Abstract]
  

  As information systems become more integrated into everyday use, people generate and store significant data through their lifetimes. Only recently have researchers and companies started to pay attention to digital legacy issues. Google has been one of the first companies to support users in planning the future of their digital assets through Google Inactive Account Manager (IAM). In this work, we present a systematic analysis of IAM and discuss how it structures users’ digital legacy decision space and deals with challenges regarding future impact of these decisions.

  @InProceedings{Prates2015MakingDecisionsDigital,
  abstract = {As information systems become more integrated into everyday use, people generate and store significant data through their lifetimes. Only recently have researchers and companies started to pay attention to digital legacy issues. Google has been one of the first companies to support users in planning the future of their digital assets through Google Inactive Account Manager (IAM). In this work, we present a systematic analysis of IAM and discuss how it structures users' digital legacy decision space and deals with challenges regarding future impact of these decisions.},
  address = {Cham, Switzerland},
  author = {Prates, R.O. and Rosson, M.B. and de Souza, C.S.},
  booktitle = {Human-Computer Interaction – INTERACT 2015},
  editor = {Julio Abascal and Simone Barbosa and Mirko Fetter and Tom Gross and Philippe Palanque and Marco Winckler},
  location = {Bamberg, Germany, September 14-18, 2015},
  pages = {201--209},
  publisher = {Springer International Publishing},
  title = {Making Decisions about Digital Legacy with Google{\'}s Inactive Account Manager},
  year = {2015},
  organization = {IFIP International Federation for Information Processing},
  series = {Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)},
  volume = {9296},
  doi = {10.1007/978-3-319-22701-6_14},
  isbn = {9783319227009},
  issn = {16113349 03029743},
  keywords = {Anticipation,Configuration settings,Digital legacy,Future impact},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• R. O. Prates, M. B. Rosson, and C. S. de Souza, “Interaction anticipation: communicating impacts of groupware configuration settings to users,” in End-user development. proceedings of 5th international symposium, is-eud 2015, Cham, Switzerland, 2015, p. 192–197. doi:10.1007/978-3-319-18425-8_15
  [BibTeX] [Abstract]
  

  As collaborative systems have become more integrated into everyday life, designers have tried to bridge the social-technical gap by building more flexible systems that allow users to configure their interactions with other users (e.g. who sees their photos). Although researchers have studied configuration in groupware, we have not found any research on whether and how users can anticipate possible interactive paths that are defined as a consequence of their choices and how these paths might be impacted by other users’ actions over time. In this brief paper we offer an initial framing of what we call the interaction anticipation problem and propose five challenges that designers must face in order to address it.

  @InProceedings{Prates2015InteractionAnticipationCommunicating,
  abstract = {As collaborative systems have become more integrated into everyday life, designers have tried to bridge the social-technical gap by building more flexible systems that allow users to configure their interactions with other users (e.g. who sees their photos). Although researchers have studied configuration in groupware, we have not found any research on whether and how users can anticipate possible interactive paths that are defined as a consequence of their choices and how these paths might be impacted by other users' actions over time. In this brief paper we offer an initial framing of what we call the interaction anticipation problem and propose five challenges that designers must face in order to address it.},
  address = {Cham, Switzerland},
  author = {Prates, R.O. and Rosson, M.B. and de Souza, C.S.},
  booktitle = {End-User Development. Proceedings of 5th International Symposium, IS-EUD 2015},
  location = {Madrid, Spain, May 26-29, 2015},
  pages = {192--197},
  publisher = {Springer International Publishing},
  title = {Interaction Anticipation: Communicating Impacts of Groupware Configuration Settings to Users},
  year = {2015},
  series = {Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)},
  volume = {9083},
  doi = {10.1007/978-3-319-18425-8_15},
  isbn = {9783319184241},
  issn = {16113349 03029743},
  keywords = {Anticipation,Groupware configuration setting,Interactive paths},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• L. Müller, M. S. Silveira, and C. S. de Souza, “Os meus, os seus, os nossos: reuso de exemplo e a autoexpressão de alunos de programação,” in Anais do xiv simpósio brasileiro sobre fatores humanos em sistemas computacionais (ihc 2015), Porto Alegre, RS., 2015, p. 292–301.
  [BibTeX] [Abstract] [Download PDF]
  

  Exemplos são comumente utilizados como base paraensino e aprendizado na área de programação de computadores. No entanto, vê-se que estudantes de programação (e até mesmo programadores experientes) negligenciam a etapa de compreensão do código e da mensagem que este código está passando, optando por um reuso e readaptação do mesmo para rápida e facilmente atingir seus objetivos. O presente trabalho investiga como alunos de programação usam exemplos em suas atividades e, em caso de reuso de código, como ocorre a apropriação da mensagem destes exemplos e como isto impacta em sua autoexpressão e na mensagem final que estão passando adiante através do programa.

  @InProceedings{Mueller2015OsMeusOs,
  abstract = {Exemplos são comumente utilizados como base paraensino e aprendizado na área de programação de computadores. No entanto, vê-se que estudantes de programação (e até mesmo programadores experientes) negligenciam a etapa de compreensão do código e da mensagem que este código está passando, optando por um reuso e readaptação do mesmo para rápida e facilmente atingir seus objetivos. O presente trabalho investiga como alunos de programação usam exemplos em suas atividades e, em caso de reuso de código, como ocorre a apropriação da mensagem destes exemplos e como isto impacta em sua autoexpressão e na mensagem final que estão passando adiante através do programa.},
  address = {Porto Alegre, RS.},
  author = {Luana Müller and Milene Selbach Silveira and Clarisse Sieckenius de Souza},
  booktitle = {Anais do XIV Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais (IHC 2015)},
  editor = {Clodis Boscarioli and Andreia Libório Sampaio},
  location = {Salvador},
  pages = {292--301},
  publisher = {Siociedade Brasileira de Computação},
  title = {Os Meus, Os Seus, Os Nossos: Reuso de Exemplo e a Autoexpressão de Alunos de Programação},
  year = {2015},
  organization = {Sociedade Brasileira de Computação},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {https://www.researchgate.net/publication/286458709_Os_meus_os_seus_os_nossos_reuso_de_exemplo_e_a_autoexpressao_de_alunos_de_programacao},
  }

2014

• R. Brandão, C. de Souza, and R. Cerqueira, “Uma infraestrutura de captura & acesso para instrumentação de avaliações qualitativas de ihc,” in Proceedings of the 13th brazilian symposium on human factors in computing systems, Porto Alegre, Brazil, Brazil, 2014, p. 197–206.
  [BibTeX] [Abstract] [Download PDF]
  

  Registering, indexing and retrieving analysis activities on empirical data is a practical and conceptual challenge in qualitative research. The publication of analytical procedures and interpretation processes is a critical requirement for external researchers and other stakeholders to accept or refute qualitative analysis results, thereby promoting its reliability. In this paper, we present a case study using a Capture & Access infrastructure to instrument qualitative HCI evaluation activities. We present the documentation of two evaluation tasks, where experts used Semiotic Engineering methods and had their activities captured and made available in hypermedia documents. In conclusion, we highlight the value of the proposed technology as a tool for qualitative research and propose a number of items for a future work agenda in this field.

  @InProceedings{Brandao2014UmaInfraestruturade,
  abstract = {Registering, indexing and retrieving analysis activities on empirical data is a practical and conceptual challenge in qualitative research. The publication of analytical procedures and interpretation processes is a critical requirement for external researchers and other stakeholders to accept or refute qualitative analysis results, thereby promoting its reliability. In this paper, we present a case study using a Capture \& Access infrastructure to instrument qualitative HCI evaluation activities. We present the documentation of two evaluation tasks, where experts used Semiotic Engineering methods and had their activities captured and made available in hypermedia documents. In conclusion, we highlight the value of the proposed technology as a tool for qualitative research and propose a number of items for a future work agenda in this field.},
  address = {Porto Alegre, Brazil, Brazil},
  author = {Brandão, Rafael and de Souza, Clarisse and Cerqueira, Renato},
  booktitle = {Proceedings of the 13th Brazilian Symposium on Human Factors in Computing Systems},
  editor = {Carla Leitão and Cristiano Maciel},
  location = {Foz do Igua\ccu, Brazil},
  pages = {197--206},
  publisher = {Sociedade Brasileira de Computa\ccão},
  title = {Uma Infraestrutura de Captura \& Acesso para Instrumentação de Avaliações Qualitativas de IHC},
  year = {2014},
  series = {IHC '14},
  acmid = {2738088},
  isbn = {978-85-7669-291-1},
  keywords = {capture \& access, hypermedia documents, qualitative research, research traceability},
  numpages = {10},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://dl.acm.org/citation.cfm?id=2738055.2738088},
  }

• P. Braz, V. Felipe David, A. Raposo, S. D. J. Barbosa, and C. S. de Souza, “An alternative design perspective for technology supporting youngsters with autism,” in Foundations of augmented cognition. advancing human performance and decision-making through adaptive systems, Cham, Switzerland, 2014, p. 279–287. doi:10.1007/978-3-319-07527-3_26
  [BibTeX] [Abstract]
  

  People with autism present several disabilities in communication, social interaction and behavioral fields. There is a wide variation among these individuals and it is essential to develop therapies and materials customized for them. There are many design approaches in Human-Computer Interaction, but most of them present some limitations for designing to this audience. We conducted a study using paper prototyping with children with autism in order to contribute to the design of software for them. In this paper, we report some limitations in using this technique and the need for customizing applications for the individual who will use them. Reflecting on these needs and analyzing approaches to interface design, we present and discuss a proposal for a design methodology that combines Meta-design and Semiotic Engineering.

  @InProceedings{Braz2014AlternativeDesignPerspective,
  abstract = {People with autism present several disabilities in communication, social interaction and behavioral fields. There is a wide variation among these individuals and it is essential to develop therapies and materials customized for them. There are many design approaches in Human-Computer Interaction, but most of them present some limitations for designing to this audience. We conducted a study using paper prototyping with children with autism in order to contribute to the design of software for them. In this paper, we report some limitations in using this technique and the need for customizing applications for the individual who will use them. Reflecting on these needs and analyzing approaches to interface design, we present and discuss a proposal for a design methodology that combines Meta-design and Semiotic Engineering.},
  address = {Cham, Switzerland},
  author = {Braz, P. and Felipe David, V. and Raposo, A. and Barbosa, S.D.J. and de Souza, C.S.},
  booktitle = {Foundations of Augmented Cognition. Advancing Human Performance and Decision-Making through Adaptive Systems},
  location = {HCI International 2014, Heraklion, Crete, Greece, June 22-27, 2014},
  pages = {279--287},
  publisher = {Springer},
  title = {An Alternative Design Perspective for Technology Supporting Youngsters with Autism},
  year = {2014},
  series = {Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)},
  volume = {8534},
  doi = {10.1007/978-3-319-07527-3_26},
  isbn = {9783319075266},
  issn = {16113349 03029743},
  keywords = {Autism,Meta-design,Prototyping,Semiotic Engineering},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, L. C. Salgado, C. F. Leitão, and M. M. Serra, “Cultural appropriation of computational thinking acquisition research: seeding fields of diversity,” in Iticse 2014 – proceedings of the 2014 innovation and technology in computer science education conference, 2014, p. 117–122. doi:10.1145/2591708.2591729
  [BibTeX] [Abstract]
  

  In this paper, we report the developments of a Computational Thinking Acquisition project carried out in pilot Brazilian schools. The project is a branch of a successful, more than a decade old project in the USA. We present and discuss the factors that led to specific cultural appropriation and diversification of the North American experience. In particular, we explain the kind of technology that has been developed in South America compared to the one developed and used in the USA, and propose that the lessons we have learned in the project{\’}s short history in Brazil can already seed the reflection of IT and Education researchers.

  @InProceedings{Souza2014CulturalAppropriationComputational,
  abstract = {In this paper, we report the developments of a Computational Thinking Acquisition project carried out in pilot Brazilian schools. The project is a branch of a successful, more than a decade old project in the USA. We present and discuss the factors that led to specific cultural appropriation and diversification of the North American experience. In particular, we explain the kind of technology that has been developed in South America compared to the one developed and used in the USA, and propose that the lessons we have learned in the project{\'}s short history in Brazil can already seed the reflection of IT and Education researchers.},
  author = {de Souza, C.S. and Salgado, L.C. and Leitão, C.F. and Serra, M.M.},
  booktitle = {ITICSE 2014 - Proceedings of the 2014 Innovation and Technology in Computer Science Education Conference},
  pages = {117--122},
  title = {Cultural Appropriation of Computational Thinking Acquisition Research: Seeding Fields of Diversity},
  year = {2014},
  doi = {10.1145/2591708.2591729},
  isbn = {9781450328333},
  keywords = {AgentSheets,Computational Thinking Acquisition,Programming},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

2013

• C. M. D. Ferreira, L. C. C. Salgado, and C. S. de Souza, “A vocabulary to access users’ cultural perspectives in human-computer interaction,” in Human-computer interaction – interact 2013, Berlin Heidelberg, 2013, p. 314–322. doi:10.1007/978-3-642-40498-6_24
  [BibTeX] [Abstract]
  

  This paper presents research carried out to explore the implications of giving users a specific vocabulary to express their perceptions and opinions about opportunities to make contact with cultural diversity in human-computer interaction. This two-step study is part of a broader research project that aims at investigating users’ perceptions and reactions when interacting with cross-cultural systems. Our current findings point at the expressive power of the proposed vocabulary and the promising outcomes of using it in the interaction design cycle of cross-cultural systems.

  @InProceedings{Ferreira2013VocabularyAccessUsers,
  abstract = {This paper presents research carried out to explore the implications of giving users a specific vocabulary to express their perceptions and opinions about opportunities to make contact with cultural diversity in human-computer interaction. This two-step study is part of a broader research project that aims at investigating users' perceptions and reactions when interacting with cross-cultural systems. Our current findings point at the expressive power of the proposed vocabulary and the promising outcomes of using it in the interaction design cycle of cross-cultural systems.},
  address = {Berlin Heidelberg},
  author = {Ferreira, C. M. D. and Salgado, L. C. C. and de Souza, C.S.},
  booktitle = {Human-Computer Interaction – INTERACT 2013},
  editor = {Kotze, P. and Marsden, G. and Lindgaard, G. and Wesson, J. and Winckler, M.},
  location = {Cape Town, South Africa, September 2-6, 2013},
  pages = {314--322},
  publisher = {Springer},
  title = {A Vocabulary to Access Users' Cultural Perspectives in Human-computer Interaction},
  year = {2013},
  number = {PART 4},
  organization = {IFIP International Federation for Information Processing},
  series = {Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)},
  volume = {8120},
  doi = {10.1007/978-3-642-40498-6_24},
  isbn = {9783642404979},
  issn = {03029743 16113349},
  keywords = {Cross-Cultural evaluation,Cultural Viewpoint Metaphors,Culture},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• J. J. Ferreira and C. S. de Souza, “Communicating ideas in computer-supported modeling tasks: a case study with bpmn,” in Human-computer interaction. human-centred design approaches, methods, tools, and environments, Berlin Heidelberg, 2013, p. 320–329. doi:10.1007/978-3-642-39232-0_36
  [BibTeX] [Abstract]
  

  The communication role of models in Software Engineering is widely acknowledged. Models tell model users what model builders propose. Computer-supported modeling (CSMod) traditionally concentrates on helping users build models with various kinds of notations. Although such focus on ‘representation’ is obviously important for the overall ‘communication’ goal, some design features in CSMod tools may be yet unexplored. This paper presents a study with the use of ARIS EXPRESS in modeling tasks with Business Process Modeling Notation (BPMN). We report on how we combined various methods to analyze the way in which this tool supports ‘communication through models’. Our findings articulate semiotic and cognitive aspects of notations with evidence provided by study participants during tasks and interviews. Our contribution lies not only in the findings, and how CSMod design can evolve in relatively unexplored ways, but also in our methodology, which we believe can be used in similar contexts.

  @InProceedings{Ferreira2013CommunicatingIdeasComputer,
  abstract = {The communication role of models in Software Engineering is widely acknowledged. Models tell model users what model builders propose. Computer-supported modeling (CSMod) traditionally concentrates on helping users build models with various kinds of notations. Although such focus on 'representation' is obviously important for the overall 'communication' goal, some design features in CSMod tools may be yet unexplored. This paper presents a study with the use of ARIS EXPRESS in modeling tasks with Business Process Modeling Notation (BPMN). We report on how we combined various methods to analyze the way in which this tool supports 'communication through models'. Our findings articulate semiotic and cognitive aspects of notations with evidence provided by study participants during tasks and interviews. Our contribution lies not only in the findings, and how CSMod design can evolve in relatively unexplored ways, but also in our methodology, which we believe can be used in similar contexts.},
  address = {Berlin Heidelberg},
  author = {Ferreira, J.J. and de Souza, C.S.},
  booktitle = {Human-Computer Interaction. Human-Centred Design Approaches, Methods, Tools, and Environments},
  editor = {Kurosu, Masaaki},
  location = {Las Vegas, NV, USA, July 21-26, 2013},
  pages = {320--329},
  publisher = {Springer},
  title = {Communicating Ideas in Computer-Supported Modeling Tasks: A Case Study with BPMN},
  year = {2013},
  number = {PART 1},
  series = {Lecture Notes in Computer Science},
  volume = {8004},
  doi = {10.1007/978-3-642-39232-0_36},
  isbn = {9783642392313},
  issn = {03029743 16113349},
  keywords = {BPMN,Cognitive dimensions of notations,Communication,Computer-supported modeling,Discourse analysis,Modeling notation,Semiotic engineering methods},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. F. Leitão, M. S. Silveira, and C. S. de Souza, “Uma introdução à engenharia semiótica: conceitos e métodos,” in Proceedings of the 12th brazilian symposium on human factors in computing systems, Porto Alegre, Brazil, Brazil, 2013, p. 356–358.
  [BibTeX] [Abstract] [Download PDF]
  

  Este minicurso apresenta uma introdução da Engenharia Semiótica, teoria de IHC criada no Brasil. Centrada nos fenômenos de significação e comunicação, ela é particularmente atraente para as aplicações interativas contemporâneas. O minicurso visa possibilitar aos participantes a aquisição de uma sólida visão de conjunto da ontologia e dos métodos propostos pela teoria, o que lhes facultará aprofundar conhecimentos, conforme suas necessidades ou interesses. É dirigido tanto para profissionais de mercado quanto para estudantes e pesquisadores, incluindo no programa de 6 horas atividades práticas para a fixação de conceitos.

  @InProceedings{Leitao2013UmaIntroducaoa,
  abstract = {Este minicurso apresenta uma introdução da Engenharia Semiótica, teoria de IHC criada no Brasil. Centrada nos fenômenos de significação e comunicação, ela é particularmente atraente para as aplicações interativas contemporâneas. O minicurso visa possibilitar aos participantes a aquisição de uma sólida visão de conjunto da ontologia e dos métodos propostos pela teoria, o que lhes facultará aprofundar conhecimentos, conforme suas necessidades ou interesses. É dirigido tanto para profissionais de mercado quanto para estudantes e pesquisadores, incluindo no programa de 6 horas atividades práticas para a fixação de conceitos.},
  address = {Porto Alegre, Brazil, Brazil},
  author = {Leitão, Carla Faria and Silveira, Milene Selbach and de Souza, Clarisse Sieckenius},
  booktitle = {Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems},
  location = {Manaus, Brazil},
  pages = {356--358},
  publisher = {Brazilian Computer Society},
  title = {Uma Introdução à Engenharia Semiótica: Conceitos e Métodos},
  year = {2013},
  series = {IHC '13},
  acmid = {2577200},
  isbn = {978-85-7669-278-2},
  keywords = {engenharia semiótica, métodos, ontologia, teoria de IHC},
  numpages = {3},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://dl.acm.org/citation.cfm?id=2577101.2577200},
  }

• I. T. Monteiro, A. S. Alves, and C. S. de Souza, “Using mediated communication to teach vocational concepts to deaf users,” in Universal access in human-computer interaction. applications and services for quality of life, Berlin Heidelberg, 2013, p. 213–222. doi:10.1007/978-3-642-39194-1-25
  [BibTeX] [Abstract]
  

  This paper presents an in-depth study on how a small group of deaf users reacted while learning abstract vocational concepts in the domain of librarianship, using mediated interaction supported by WNH, a Web Navigation Helper. WNH{\’}s purpose is to allow helpers to create mediation dialogs to enable or facilitate helpees’ online interaction with Web pages. In our study, deaf employees at a Brazilian library were taught a lesson especially designed for WNH by a deaf librarian who is fluent in Brazilian Sign Language (LIBRAS) and Portuguese. Among the results we were able to see the huge gaps between what a library is for our deaf participants and what it is for non-deaf library professionals and customers. We could also appreciate the role of technologies like WNH in preparing deaf users to interact with Web systems in professional settings.

  @InProceedings{Monteiro2013UsingMediatedCommunication,
  abstract = {This paper presents an in-depth study on how a small group of deaf users reacted while learning abstract vocational concepts in the domain of librarianship, using mediated interaction supported by WNH, a Web Navigation Helper. WNH{\'}s purpose is to allow helpers to create mediation dialogs to enable or facilitate helpees' online interaction with Web pages. In our study, deaf employees at a Brazilian library were taught a lesson especially designed for WNH by a deaf librarian who is fluent in Brazilian Sign Language (LIBRAS) and Portuguese. Among the results we were able to see the huge gaps between what a library is for our deaf participants and what it is for non-deaf library professionals and customers. We could also appreciate the role of technologies like WNH in preparing deaf users to interact with Web systems in professional settings.},
  address = {Berlin Heidelberg},
  author = {Monteiro, I. T. and Alves, A. S. and de Souza, C.S.},
  booktitle = {Universal Access in Human-Computer Interaction. Applications and Services for Quality of Life},
  editor = {tephanidis, Constantine and Antona, Margherita},
  location = {HCI International 2013, Las Vegas, NV, USA, July 21-26, 2013,},
  pages = {213--222},
  publisher = {Springer},
  title = {Using Mediated Communication to Teach Vocational Concepts to Deaf Users},
  year = {2013},
  number = {PART 3},
  series = {Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)},
  volume = {8011},
  doi = {10.1007/978-3-642-39194-1-25},
  isbn = {9783642391934},
  issn = {03029743 16113349},
  keywords = {Mediated communication,deaf learners,vocational education},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• I. T. Monteiro, C. S. de Souza, and C. F. Leitão, “Metacommunication and semiotic engineering: insights from a study with mediated hci,” in Design, user experience, and usability. design philosophy, methods, and tools, Berlin Heidelberg, 2013, p. 115–124. doi:10.1007/978-3-642-39229-0_14
  [BibTeX] [Abstract]
  

  Semiotic perspectives on HCI take human-computer interaction as a special case of computer-mediated human communication. Through the interface, systems designers communicate to users their design vision as well as how the system can or should be used for a variety of purposes. To date, there hasn’t been enough empirical research in HCI exploring this complex phenomenon. This paper reports an empirical research about metacommunication in HCI and discusses how and why semiotically-inspired research can contribute to advance knowledge in this field. The aim of the discussion is to motivate and justify more research projects in this interdisciplinary territory and to present semiotic engineering concepts and tools that can be used to carry them out.

  @InProceedings{Monteiro2013MetacommunicationSemioticEngineering,
  abstract = {Semiotic perspectives on HCI take human-computer interaction as a special case of computer-mediated human communication. Through the interface, systems designers communicate to users their design vision as well as how the system can or should be used for a variety of purposes. To date, there hasn't been enough empirical research in HCI exploring this complex phenomenon. This paper reports an empirical research about metacommunication in HCI and discusses how and why semiotically-inspired research can contribute to advance knowledge in this field. The aim of the discussion is to motivate and justify more research projects in this interdisciplinary territory and to present semiotic engineering concepts and tools that can be used to carry them out.},
  address = {Berlin Heidelberg},
  author = {Monteiro, I. T. and de Souza, C.S. and Leitão, C. F.},
  booktitle = {Design, User Experience, and Usability. Design Philosophy, Methods, and Tools},
  editor = {Marcus, Aaron},
  location = {HCI International 2013, Las Vegas, NV, USA, July 21-26, 2013},
  pages = {115--124},
  publisher = {Springer},
  title = {Metacommunication and Semiotic Engineering: Insights from a Study with Mediated HCI},
  year = {2013},
  number = {PART 1},
  series = {Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)},
  volume = {8012},
  doi = {10.1007/978-3-642-39229-0_14},
  isbn = {9783642392283},
  issn = {03029743 16113349},
  keywords = {Semiotic engineering,computer-mediated human communication,end-user development,mediated web navigation},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• I. T. Monteiro, E. T. Tolmasquim, and C. S. de Souza, “Going back and forth in metacommunication threads,” in Proceedings of the 12th brazilian symposium on human factors in computing systems, Porto Alegre, Brazil, Brazil, 2013, p. 102–111.
  [BibTeX] [Abstract] [Download PDF]
  

  This paper presents an exploratory study about how savvy end users configure return points in mediated interactions with Web applications through WNH (Web Navigation Helper), a user agent that supports rephrasing, explanation, commentary and elaboration of interaction in scripted Web activities. The study is part of a long-term research on self-expression through software programming. Savvy users creating mediation dialogs for the benefit of other users (third parties) are actually engaged in a human-computer interaction (HCI) design process involved in end user development (EUD). The study shows that decisions about when, where, how and why to go back to previous points in the design of mediated conversation with WNH are very complex, even for savvy users. More importantly, we collected powerful evidence of the participants’ interpretation of what interaction through WNH is all about. We believe that such evidence stands for their intuitions about HCI in a broader sense. The main contribution of the study is thus to illuminate aspects of EUD and HCI that haven’t been discussed to-date and to propose questions for new kinds of investigation.

  @InProceedings{Monteiro2013GoingBackForth,
  abstract = {This paper presents an exploratory study about how savvy end users configure return points in mediated interactions with Web applications through WNH (Web Navigation Helper), a user agent that supports rephrasing, explanation, commentary and elaboration of interaction in scripted Web activities. The study is part of a long-term research on self-expression through software programming. Savvy users creating mediation dialogs for the benefit of other users (third parties) are actually engaged in a human-computer interaction (HCI) design process involved in end user development (EUD). The study shows that decisions about when, where, how and why to go back to previous points in the design of mediated conversation with WNH are very complex, even for savvy users. More importantly, we collected powerful evidence of the participants' interpretation of what interaction through WNH is all about. We believe that such evidence stands for their intuitions about HCI in a broader sense. The main contribution of the study is thus to illuminate aspects of EUD and HCI that haven't been discussed to-date and to propose questions for new kinds of investigation.},
  address = {Porto Alegre, Brazil, Brazil},
  author = {Monteiro, Ingrid Teixeira and Tolmasquim, Eduardo Tiomno and de Souza, Clarisse Sieckenius},
  booktitle = {Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems},
  location = {Manaus, Brazil},
  pages = {102--111},
  publisher = {Brazilian Computer Society},
  title = {Going Back and Forth in Metacommunication Threads},
  year = {2013},
  series = {IHC '13},
  acmid = {2577124},
  isbn = {978-85-7669-278-2},
  keywords = {back navigation, dialog management, end-user development, mediated metacommunication},
  numpages = {10},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://dl.acm.org/citation.cfm?id=2577101.2577124},
  }

• M. P. Mota, I. T. Monteiro, J. J. Ferreira, C. Slaviero, and C. S. de Souza, “On signifying the complexity of inter-agent relations in agentsheets games and simulations,” in Sigdoc 2013 – proceedings of the 31st acm international conference on design of communication, New York, NY, USA, 2013, p. 133–142. doi:10.1145/2507065.2507070
  [BibTeX] [Abstract]
  

  This paper reports the results of an empirical study about the semiotic engineering of signs of complexity for live documentation of games and simulations built with a visual programming learning environment. The study highlights the essence of the semiotic engineering process and shows how its outcome has been received by a group of users who can speak for a large portion of the live documentation system{\’}s user population. It also shows how the communication of complexity is, in and of itself, a major design challenge, especially when mastering complexity is one of the prime purposes of the documented object. Because the study was carried out in the context of a live documentation system, its conclusions can also illustrate how to conduct semiotically-inspired interaction design.

  @InProceedings{Mota2013SignifyingComplexityInter,
  abstract = {This paper reports the results of an empirical study about the semiotic engineering of signs of complexity for live documentation of games and simulations built with a visual programming learning environment. The study highlights the essence of the semiotic engineering process and shows how its outcome has been received by a group of users who can speak for a large portion of the live documentation system{\'}s user population. It also shows how the communication of complexity is, in and of itself, a major design challenge, especially when mastering complexity is one of the prime purposes of the documented object. Because the study was carried out in the context of a live documentation system, its conclusions can also illustrate how to conduct semiotically-inspired interaction design.},
  address = {New York, NY, USA},
  author = {Mota, M.P. and Monteiro, I.T. and Ferreira, J.J. and Slaviero, C. and de Souza, C.S.},
  booktitle = {SIGDOC 2013 - Proceedings of the 31st ACM International Conference on Design of Communication},
  location = {Greenville, North Carolina, USA},
  pages = {133--142},
  publisher = {ACM},
  title = {On Signifying the Complexity of Inter-Agent Relations in Agentsheets Games and Simulations},
  year = {2013},
  series = {SIGDOC '13},
  acmid = {2507070},
  doi = {10.1145/2507065.2507070},
  isbn = {9781450321310},
  keywords = {agentsheets.,computational thinking acquisition,live documentation,meaning of program representations,semiotic engineering in practice},
  numpages = {10},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• R. O. Prates, S. Barbosa, M. S. Silveira, C. S. de Souza, C. Baranauskas, C. Maciel, E. Furtado, J. Anacleto, P. Melo, and T. Kujala, “Hci community in brazil—sweet 16!,” Interactions, vol. 20, iss. 6, p. 80–81, 2013. doi:10.1145/2530983
  [BibTeX] [Abstract]
  

  Back in 1996, a small group of Brazilian Ph.D. students attended CHI as student volunteers and were encouraged to find out who else was working with HCI in Brazil. In 1997 the first efforts to organize the Brazilian HCI community came about, with significant contributions from Richard Anderson, then SIGCHI{\’}s chair of Local Chapters. In addition to identifying other people working in HCI, Brazilian HCI researchers created a webpage with their news and contact information and set up both a mailing list and a SIGCHI Prospective Local Chapter: BR-CHI. In 2000 these efforts culminated with the chartering of BR-CHI and the organization of the first national research workshop in HCI. Sixteen years later, the community has consolidated and blossomed. The Brazilian Symposium on Human Factors in Computing Systems (IHC) is an annual event. At recent symposiums we counted some 200 participants and about 100 full paper submissions, with a 30 percent acceptance rate. In 2002 the Brazilian Computer Society created a Special Commission on HCI, and its Executive Council (CEIHC) is responsible for the quality of IHC and for promoting the HCI field in Brazil. CEIHC has assigned members of the community to lead efforts in HCI education, research, and academia-industry relations in Brazil.

  @Article{Prates2013HCICommunityBrazil—sweet,
  abstract = {Back in 1996, a small group of Brazilian Ph.D. students attended CHI as student volunteers and were encouraged to find out who else was working with HCI in Brazil. In 1997 the first efforts to organize the Brazilian HCI community came about, with significant contributions from Richard Anderson, then SIGCHI{\'}s chair of Local Chapters. In addition to identifying other people working in HCI, Brazilian HCI researchers created a webpage with their news and contact information and set up both a mailing list and a SIGCHI Prospective Local Chapter: BR-CHI. In 2000 these efforts culminated with the chartering of BR-CHI and the organization of the first national research workshop in HCI.
  Sixteen years later, the community has consolidated and blossomed. The Brazilian Symposium on Human Factors in Computing Systems (IHC) is an annual event. At recent symposiums we counted some 200 participants and about 100 full paper submissions, with a 30 percent acceptance rate. In 2002 the Brazilian Computer Society created a Special Commission on HCI, and its Executive Council (CEIHC) is responsible for the quality of IHC and for promoting the HCI field in Brazil. CEIHC has assigned members of the community to lead efforts in HCI education, research, and academia-industry relations in Brazil.},
  author = {Prates, Raquel O. and Barbosa, Simone and Silveira, Milene S. and de Souza, Clarisse S. and Baranauskas, Cecı́lia and Maciel, Cristiano and Furtado, Elizabeth and Anacleto, Junia and Melo, Paulo and Kujala, Tuomo},
  journal = {interactions},
  pages = {80--81},
  title = {HCI Community in Brazil—sweet 16!},
  volume = {20},
  year = {2013},
  doi = {10.1145/2530983},
  month = nov,
  number = {6},
  acmid = {2530983},
  address = {New York, NY, USA},
  issn = {1072-5520},
  issue_date = {November + December 2013},
  numpages = {2},
  owner = {SERG},
  publisher = {ACM},
  timestamp = {2020-10-21},
  }

• L. C. C. Salgado, C. F. Leitão, and C. S. de Souza, A journey through cultures – metaphors for guiding the design of cross-cultural interactive systems, London: Springer-verlag, 2013. doi:10.1007/978-1-4471-4114-3
  [BibTeX] [Abstract] [Download PDF]
  

  A Journey Through Cultures addresses one of the hottest topics in contemporary HCI: cultural diversity amongst users. For a number of years the HCI community has been investigating alternatives to enhance the design of cross-cultural systems. Most contributions to date have followed either a {\”}design for each{\”} or a {\”}design for all{\”} strategy. A Journey Through Cultures takes a very different approach. Proponents of CVM – the Cultural Viewpoint Metaphors perspective – the authors invite HCI practitioners to think of how to expose and communicate the idea of cultural diversity. A detailed case study is included which assesses the metaphorsâ potential in cross-cultural design and evaluation. The results show that cultural viewpoint metaphors have strong epistemic power, leveraged by a combination of theoretic foundations coming from Anthropology, Semiotics and the authorsâ own work in HCI and Semiotic Engineering. Luciana Salgado, Carla Leitão and Clarisse de Souza are members of SERG, the Semiotic Engineering Research Group at the Departamento de Informática of Rio de Janeiro{\’}s Pontifical Catholic University (PUC-Rio).

  @Book{Salgado2013JourneyCulturesMetaphors,
  address = {London},
  author = {Salgado, L.C.C. and Leitão, C.F. and de Souza, C.S.},
  location = {London},
  publisher = {Springer-Verlag},
  title = {A Journey through Cultures - Metaphors for Guiding the Design of Cross-Cultural Interactive Systems},
  year = {2013},
  abstract = {A Journey Through Cultures addresses one of the hottest topics in contemporary HCI: cultural diversity amongst users. For a number of years the HCI community has been investigating alternatives to enhance the design of cross-cultural systems. Most contributions to date have followed either a {\"}design for each{\"} or a {\"}design for all{\"} strategy. A Journey Through Cultures takes a very different approach. Proponents of CVM -- the Cultural Viewpoint Metaphors perspective -- the authors invite HCI practitioners to think of how to expose and communicate the idea of cultural diversity. A detailed case study is included which assesses the metaphors{\^a} potential in cross-cultural design and evaluation. The results show that cultural viewpoint metaphors have strong epistemic power, leveraged by a combination of theoretic foundations coming from Anthropology, Semiotics and the authors{\^a} own work in HCI and Semiotic Engineering. Luciana Salgado, Carla Leit{\~a}o and Clarisse de Souza are members of SERG, the Semiotic Engineering Research Group at the Departamento de Inform{\'a}tica of Rio de Janeiro{\'}s Pontifical Catholic University (PUC-Rio).},
  series = {Human Computer Interaction Series},
  doi = {10.1007/978-1-4471-4114-3},
  keywords = {Culture and Human-Computer Interaction, Cross-Cultural HCI Design, Semiotic Engineering},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://www.springer.com/computer/hci/book/978-1-4471-4113-6},
  }

• C. S. de Souza, “Semiotic perspectives on interactive languages for life on the screen,” Journal of visual languages and computing, vol. 24, iss. 3, p. 218–221, 2013. doi:10.1016/j.jvlc.2013.03.002
  [BibTeX] [Abstract]
  

  Cross-disciplinary research involving semiotics and computer science is rare. With the Web 2.0, contemporary activities of users can be properly described as real ‘life on the screen’. One of the challenges for the design of interactive languages is to support these activities and to express the much wider variety of meanings that users want to exchange through and with software. As the discipline whose aim is to investigate meanings, through representation and interpretation processes, semiotics is remarkably well-positioned to contribute with new knowledge in our field. This viewpoint article examines the reasons why in spite of this positioning, semiotics remains unpopular among researchers interested in interactive computer languages. In particular, it proposes that a semiotic approach can help us think about computer languages to represent our individual and collective {\’}s elves’ on the screen.

  @Article{Souza2013SemioticPerspectivesInteractive,
  abstract = {Cross-disciplinary research involving semiotics and computer science is rare. With the Web 2.0, contemporary activities of users can be properly described as real 'life on the screen'. One of the challenges for the design of interactive languages is to support these activities and to express the much wider variety of meanings that users want to exchange through and with software. As the discipline whose aim is to investigate meanings, through representation and interpretation processes, semiotics is remarkably well-positioned to contribute with new knowledge in our field. This viewpoint article examines the reasons why in spite of this positioning, semiotics remains unpopular among researchers interested in interactive computer languages. In particular, it proposes that a semiotic approach can help us think about computer languages to represent our individual and collective {\'}s elves' on the screen.},
  author = {de Souza, C.S.},
  journal = {Journal of Visual Languages and Computing},
  pages = {218--221},
  title = {Semiotic Perspectives on Interactive Languages for Life on the Screen},
  volume = {24},
  year = {2013},
  doi = {10.1016/j.jvlc.2013.03.002},
  number = {3},
  issn = {1045-926X},
  keywords = {Computer languages,Computer semiotics,Interactive languages,Virtual self-representation},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

2012

• L. M. Afonso, R. F. G. Cerqueira, and C. S. de Souza, “Evaluating application programming interfaces as communication artefacts,” in Proceedings of the psychology of programming interest group annual conference 2012 (ppig’2012), London, UK, 2012, p. 151–162.
  [BibTeX] [Abstract] [Download PDF]
  

  Application programming interfaces (APIs) allow the reuse of software artefacts by providing abstractions to other software layers, and their design is critical to enable the effective use of the underlying software and avoid programming errors. As such, the role of an API designer should be strengthened in any software project that has reuse among its goals. Also, we should be able to evaluate the effectiveness of an API in communicating its design to programmers and identify the tools and techniques that help the designers to accomplish this task, so that APIs may be easier to understand and use. This paper describes a work in progress that proposes the use of a combined semiotic and cognitive method to evaluate APIs as an artefact mediating the communication process between designers and programmers, and also aims to investigate some possibilities of enhancing this communication.

  @InProceedings{Afonso2012EvaluatingApplicationProgramming,
  abstract = {Application programming interfaces (APIs) allow the reuse of software artefacts by providing abstractions to other software layers, and their design is critical to enable the effective use of the underlying software and avoid programming errors. As such, the role of an API designer should be strengthened in any software project that has reuse among its goals. Also, we should be able to evaluate the effectiveness of an API in communicating its design to programmers and identify the tools and techniques that help the designers to accomplish this task, so that APIs may be easier to understand and use. This paper describes a work in progress that proposes the use of a combined semiotic and cognitive method to evaluate APIs as an artefact mediating the communication process between designers and programmers, and also aims to investigate some possibilities of enhancing this communication.},
  address = {London, UK},
  author = {Afonso, L.M. and Cerqueira, R.F.G. and de Souza, C.S.},
  booktitle = {Proceedings of the Psychology of Programming Interest Group Annual Conference 2012 (PPIG'2012)},
  location = {London, UK},
  pages = {151--162},
  publisher = {The Psychology of Programming Interest Group},
  title = {Evaluating Application Programming Interfaces as Communication Artefacts},
  year = {2012},
  month = nov,
  keywords = {Semiotic Inspection Method, Cognitive Dimensions of Notations, Computer Languages and Notations, API Programming},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {https://ppig.org/files/2012-PPIG-24th-Afonso.pdf},
  }

• C. M. C. Baranauskas, C. S. de Souza, and R. Pereira, “Grandihc-br: prospecção de grandes desafios de pesquisa em interação humano-computador no brasil,” in Companion proceedings of the 11th brazilian symposium on human factors in computing systems, Porto Alegre, Brazil, Brazil, 2012, p. 63–64.
  [BibTeX] [Abstract] [Download PDF]
  

  When the IHC2012 Chairs called us to organize a panel to discuss advances in the SBC Challenges, in particular Challenge n. 4, we were urged to {\”}hear{\”} the HCI community in a more systematic and more localized way, about what this community takes to be an HCI Challenge in the broader context of Brazilian Grand Challenges in Computing. GranDIHC-BR is our proposal to prospect during IHC2012 research questions in the field of Human-Computer Interaction that will be important to science and society over a period of 10 years, extending the reach of the SBC Challenge 4.

  @InProceedings{Baranauskas2012GrandIHCBrProspeccao,
  abstract = {When the IHC2012 Chairs called us to organize a panel to discuss advances in the SBC Challenges, in particular Challenge n. 4, we were urged to {\"}hear{\"} the HCI community in a more systematic and more localized way, about what this community takes to be an HCI Challenge in the broader context of Brazilian Grand Challenges in Computing. GranDIHC-BR is our proposal to prospect during IHC2012 research questions in the field of Human-Computer Interaction that will be important to science and society over a period of 10 years, extending the reach of the SBC Challenge 4.},
  address = {Porto Alegre, Brazil, Brazil},
  author = {Baranauskas, M. Cecilia C. and de Souza, Clarisse Sieckenius and Pereira, Roberto},
  booktitle = {Companion Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems},
  location = {Cuiaba, Brazil},
  pages = {63--64},
  publisher = {Brazilian Computer Society},
  title = {GrandIHC-Br: Prospecção de Grandes Desafios de Pesquisa Em Interação Humano-Computador no Brasil},
  year = {2012},
  series = {IHC '12},
  acmid = {2400103},
  isbn = {978-85-7669-262-1},
  keywords = {BR-CHI, Brazilian Computing Society, HCI in Brazil, community},
  numpages = {2},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://dl.acm.org/citation.cfm?id=2400076.2400103},
  }

• S. A. Bim, C. F. Leitão, and C. S. de Souza, “Can the teaching of hci contribute for the learning of computer science? the case of semiotic engineering methods,” in Proceedings of the 11th brazilian symposium on human factors in computing systems ihc’2012, Cuiabá, 2012, p. 185–194.
  [BibTeX] [Abstract] [Download PDF]
  

  This paper presents the results of an in-depth qualitative study carried out to investigate the teaching and learning of Semiotic Engineering methods, namely the Semiotic Inspection and the Communicability Evaluation methods. We identified three kinds of abilities that are necessary for a better learning and application of these methods: systematic interpretation, abstraction and wide perspective. We have also identified the relation among these three abilities. In the triangulation step of the research we found that these abilities are also recurrently invoked as necessary to the learning of other Computer Science subjects such as programming, induction, and object-oriented design and development. In conclusion, we suggest that strategies used to teach Semiotic Engineering methods can explicitly explore the connections with other contents in the Computer Science curriculum and thus begin to reap mutual benefits.

  @InProceedings{Bim2012CanTeachingHCI,
  abstract = {This paper presents the results of an in-depth qualitative study carried out to investigate the teaching and learning of Semiotic Engineering methods, namely the Semiotic Inspection and the Communicability Evaluation methods. We identified three kinds of abilities that are necessary for a better learning and application of these methods: systematic interpretation, abstraction and wide perspective. We have also identified the relation among these three abilities. In the triangulation step of the research we found that these abilities are also recurrently invoked as necessary to the learning of other Computer Science subjects such as programming, induction, and object-oriented design and development. In conclusion, we suggest that strategies used to teach Semiotic Engineering methods can explicitly explore the connections with other contents in the Computer Science curriculum and thus begin to reap mutual benefits.},
  address = {Cuiabá},
  author = {Bim, S.A. and Leitão, C.F. and de Souza, C.S.},
  booktitle = {Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems IHC'2012},
  location = {Porto Alegre, RS},
  pages = {185--194},
  publisher = {SBC Sociedade Brasileira de Computa\ccão / ACM Association for Computing Machinery},
  title = {Can the Teaching of HCI Contribute for the Learning of Computer Science? The Case of Semiotic Engineering Methods},
  year = {2012},
  month = nov,
  series = {ACM International Conference Proceedings Series},
  volume = {I},
  acmid = {2393564},
  isbn = {978-85-7669-262-1},
  keywords = {Semiotic Engineering Evaluation Methods, HCI Education, CS Education},
  numpages = {10},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://dl.acm.org/citation.cfm?id=2393536.2393564},
  }

• J. J. Ferreira, C. S. de Souza, L. C. C. Salgado, C. Slaviero, C. F. Leitão, and F. F. Moreira, “Combining cognitive, semiotic and discourse analysis to explore the power of notations in visual programming,” in 2012 ieee symposium on visual languages and human-centric computing (vl/hcc), Innsbruck, 2012, p. 101–108. doi:10.1109/VLHCC.2012.6344492
  [BibTeX] [Abstract] [Download PDF]
  

  Using game design and programming to foster computational thinking acquisition has proved to be a successful strategy in recent years. In previous research with AgentSheets, we concluded that the semiotic richness of this visual programming environment, specifically designed to support computational thinking acquisition, could be explored more extensively to the benefit of learners. In particular, we realized that there are some additional representations of AgentSheets games and simulations that are not presented as programming tools in the interface, and yet they communicate new relevant meanings to the users. This paper reports on research where we artificially introduced such representations in a small follow-up experiment with selected participants from our previous research experiment. Our goal was to investigate the impact of such additional representations on program comprehension and modification tasks. To this end we contrasted empirical evidence of their performance in the two tasks with their verbal account of experience with AgentSheets. We used a combination of discourse analysis and inspections using Semiotic Engineering methods and the Cognitive Dimensions of Notations framework. Our findings go in two directions. First, we observed that additional representations have allowed participants to expand and correct previous learning. Therefore such representations can support new teaching strategies in computational thinking acquisition programs with AgentSheets. Second, we learned that the combination of methods we used to analyze empirical data – discourse analysis with semiotic and cognitive inspection techniques – can be used systematically in other research contexts, holding the promise of insightful results.

  @InProceedings{Ferreira2012CombiningCognitiveSemiotic,
  abstract = {Using game design and programming to foster computational thinking acquisition has proved to be a successful strategy in recent years. In previous research with AgentSheets, we concluded that the semiotic richness of this visual programming environment, specifically designed to support computational thinking acquisition, could be explored more extensively to the benefit of learners. In particular, we realized that there are some additional representations of AgentSheets games and simulations that are not presented as programming tools in the interface, and yet they communicate new relevant meanings to the users. This paper reports on research where we artificially introduced such representations in a small follow-up experiment with selected participants from our previous research experiment. Our goal was to investigate the impact of such additional representations on program comprehension and modification tasks. To this end we contrasted empirical evidence of their performance in the two tasks with their verbal account of experience with AgentSheets. We used a combination of discourse analysis and inspections using Semiotic Engineering methods and the Cognitive Dimensions of Notations framework. Our findings go in two directions. First, we observed that additional representations have allowed participants to expand and correct previous learning. Therefore such representations can support new teaching strategies in computational thinking acquisition programs with AgentSheets. Second, we learned that the combination of methods we used to analyze empirical data - discourse analysis with semiotic and cognitive inspection techniques - can be used systematically in other research contexts, holding the promise of insightful results.},
  address = {Innsbruck},
  author = {Ferreira, J.J. and de Souza, C.S. and Salgado, L.C.C. and Slaviero, C. and Leitão, C.F. and Moreira, F.F.},
  booktitle = {2012 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)},
  location = {Piscathaway, NJ},
  pages = {101--108},
  publisher = {IEEE},
  title = {Combining Cognitive, Semiotic and Discourse Analysis to Explore the Power of Notations in Visual Programming},
  year = {2012},
  month = sep,
  doi = {10.1109/VLHCC.2012.6344492},
  issn = {1943-6092},
  keywords = {Cognitive Dimensions of Notations, Semiotic Inspection Method, Visual Programming, Computational Thinking, End User Programming, Computer Languages and Notations},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6344492&isnumber=6344456},
  }

• R. Maia, R. Cerqueira, C. S. de Souza, and T. Guisasola-Gorham, “A qualitative human-centric evaluation of flexibility in middleware implementations,” Empirical software engineering, vol. 17, iss. 3, p. 166–199, 2012. doi:10.1007/s10664-011-9167-7
  [BibTeX] [Abstract]
  

  Today middleware is much more powerful, more reliable and faster than it used to be. Nevertheless, for the application developer, the complexity of using middleware platforms has increased accordingly. The volume and variety of application contexts that current middleware technologies have to support require that developers be able to anticipate the widest possible range of execution environments, desired and undesired effects of different programming strategies, handling procedures for runtime errors, and so on. This paper shows how a generic framework designed to evaluate the usability of notations (the Cognitive Dimensions of Notations Framework, or CDN) has been instantiated and used to analyze the cognitive challenges involved in adapting middleware platforms. This human-centric perspective allowed us to achieve novel results compared to existing middleware evaluation research, typically centered around system performance metrics. The focus of our study is on the process of adapting middleware implementations, rather than in the end product of this activity. Our main contributions are twofold. First, we describe a qualitative CDN-based method to analyze the cognitive effort made by programmers while adapting middleware implementations. And second, we show how two platforms designed for flexibility have been compared, suggesting that certain programming language design features might be particularly helpful for developers.

  @Article{Maia2012QualitativeHumanCentric,
  abstract = {Today middleware is much more powerful, more reliable and faster than it used to be. Nevertheless, for the application developer, the complexity of using middleware platforms has increased accordingly. The volume and variety of application contexts that current middleware technologies have to support require that developers be able to anticipate the widest possible range of execution environments, desired and undesired effects of different programming strategies, handling procedures for runtime errors, and so on. This paper shows how a generic framework designed to evaluate the usability of notations (the Cognitive Dimensions of Notations Framework, or CDN) has been instantiated and used to analyze the cognitive challenges involved in adapting middleware platforms. This human-centric perspective allowed us to achieve novel results compared to existing middleware evaluation research, typically centered around system performance metrics. The focus of our study is on the process of adapting middleware implementations, rather than in the end product of this activity. Our main contributions are twofold. First, we describe a qualitative CDN-based method to analyze the cognitive effort made by programmers while adapting middleware implementations. And second, we show how two platforms designed for flexibility have been compared, suggesting that certain programming language design features might be particularly helpful for developers.},
  author = {Maia, R. and Cerqueira, R. and de Souza, C.S. and Guisasola-Gorham, T.},
  journal = {Empirical Software Engineering},
  pages = {166--199},
  title = {A Qualitative Human-Centric Evaluation of Flexibility in Middleware Implementations},
  volume = {17},
  year = {2012},
  doi = {10.1007/s10664-011-9167-7},
  number = {3},
  issn = {13823256 15737616},
  issue = {3},
  keywords = {API evaluation,Cognitive Dimensions of Notations,Middleware evaluation,Programmer experience,Qualitative methods},
  language = {English},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• I. T. Monteiro and C. S. de Souza, “The representation of self in mediated interaction with computers,” in Proceedings of the 11th brazilian symposium on human factors in computing systems ihc’2012, Cuiabá, 2012, p. 219–228.
  [BibTeX] [Abstract] [Download PDF]
  

  According to the computers as media perspective, all kinds of software, whether created by expert programmers or end users, carry an implicit or explicit representation of their creators. This paper discusses the representation of the user{\’}s self in a study with the Web Navigation Helper (WNH), a user agent designed to support Web navigation through mediation dialogs. In our study, school teachers built mediation dialogs to orient their students while navigating proposed Websites. Our findings show how this specific kind of mediation technology communicated (intentional or unintentional) self-representation and supported self-expression. They also provide insights into how similar mediation technologies can be used in the broader context of computer-supported social participation.

  @InProceedings{Monteiro2012RepresentationSelfMediated,
  abstract = {According to the computers as media perspective, all kinds of software, whether created by expert programmers or end users, carry an implicit or explicit representation of their creators. This paper discusses the representation of the user{\'}s self in a study with the Web Navigation Helper (WNH), a user agent designed to support Web navigation through mediation dialogs. In our study, school teachers built mediation dialogs to orient their students while navigating proposed Websites. Our findings show how this specific kind of mediation technology communicated (intentional or unintentional) self-representation and supported self-expression. They also provide insights into how similar mediation technologies can be used in the broader context of computer-supported social participation.},
  address = {Cuiabá},
  author = {Monteiro, I.T. and de Souza, C.S.},
  booktitle = {Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems IHC'2012},
  location = {Porto Alegre, RS},
  pages = {219--228},
  publisher = {SBC Sociedade Brasileira de Computação / ACM Association for Computing Machinery},
  title = {The Representation of Self in Mediated Interaction with Computers},
  year = {2012},
  month = nov,
  series = {ACM International Conference Proceedings Series},
  volume = {I},
  acmid = {2393569},
  isbn = {978-85-7669-262-1},
  keywords = {Computer-Mediated Communication, End User Semiotic Engineering, Representations of Self in Computer Programs, Computers as Media},
  numpages = {10},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://dl.acm.org/citation.cfm?id=2393536.2393569},
  }

• M. P. Mota, L. S. Faria, and C. S. de Souza, “Documentation comes to life in computational thinking acquisition with agentsheets,” in Proceedings of the 11th brazilian symposium on human factors in computing systems ihc’2012, Cuiabá, 2012, p. 151–160.
  [BibTeX] [Abstract] [Download PDF]
  

  This paper is about the use of live documentation in Computational Thinking Acquisition (CTA) programs with AgentSheets. AgentSheets is a visual programming environment to build games. Based on previous studies showing that semiotic relations among visual game elements could be further explored to the benefit of the learners, we designed PoliFacets, a Web extension to AgentSheets cast as a live conversational document. With it, teachers and learners can follow different threads of conversation about (multiple representations of) game elements and relations between them. We present a qualitative evaluation study of PoliFacets with two experienced AgentSheets instructors and three school teachers trained to coach students in CTA programs. Findings show that although our system has not yet completely fulfilled our design intent, it has led participants to gain relevant insights about their teaching and learning, as well as to articulating doubts and misunderstandings that otherwise could have gone unnoticed.

  @InProceedings{Mota2012DocumentationComesLife,
  abstract = {This paper is about the use of live documentation in Computational Thinking Acquisition (CTA) programs with AgentSheets. AgentSheets is a visual programming environment to build games. Based on previous studies showing that semiotic relations among visual game elements could be further explored to the benefit of the learners, we designed PoliFacets, a Web extension to AgentSheets cast as a live conversational document. With it, teachers and learners can follow different threads of conversation about (multiple representations of) game elements and relations between them. We present a qualitative evaluation study of PoliFacets with two experienced AgentSheets instructors and three school teachers trained to coach students in CTA programs. Findings show that although our system has not yet completely fulfilled our design intent, it has led participants to gain relevant insights about their teaching and learning, as well as to articulating doubts and misunderstandings that otherwise could have gone unnoticed.},
  address = {Cuiabá},
  author = {Mota, M.P. and Faria, L.S. and de Souza, C.S.},
  booktitle = {Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems IHC'2012},
  location = {Porto Alegre, RS},
  pages = {151--160},
  publisher = {SBC Sociedade Brasileira de Computação / ACM Association for Computing Machinery},
  title = {Documentation Comes to Life in Computational Thinking Acquisition with Agentsheets},
  year = {2012},
  month = nov,
  series = {ACM International Conference Proceedings Series},
  volume = {I},
  acmid = {2393569},
  isbn = {978-85-7669-262-1},
  keywords = {Documentation, Text Generation, Computational Thinking},
  numpages = {10},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://dl.acm.org/citation.cfm?id=2393536.2393558},
  }

• C. S. Soares Neto, L. F. G. Soares, and C. S. de Souza, “Tal – template authoring language,” Journal of the brazilian computer society, vol. 18, iss. 3, p. 185–199, 2012. doi:10.1007/s13173-012-0073-7
  [BibTeX] [Abstract]
  

  This paper presents TAL (Template Authoring Language), an authoring language for hypermedia document templates. Templates describe document families with structural or semantic similarities among them. TAL supports the description of templates independently of the target hypermedia authoring language. The paper also presents a TAL processor that generates complete hypermedia documents taking as input a template specification in TAL and a data file with the information that makes that document particular in its family.

  @Article{SoaresNeto2012TalTemplateAuthoring,
  abstract = {This paper presents TAL (Template Authoring Language), an authoring language for hypermedia document templates. Templates describe document families with structural or semantic similarities among them. TAL supports the description of templates independently of the target hypermedia authoring language. The paper also presents a TAL processor that generates complete hypermedia documents taking as input a template specification in TAL and a data file with the information that makes that document particular in its family.},
  author = {Soares Neto, C.S. and Soares, L.F.G. and de Souza, C.S.},
  journal = {Journal of the Brazilian Computer Society},
  pages = {185--199},
  title = {Tal - Template Authoring Language},
  volume = {18},
  year = {2012},
  doi = {10.1007/s13173-012-0073-7},
  number = {3},
  issn = {01046500 16784804},
  keywords = {Hypermedia authoring,Hypermedia design patterns,Nested context language,TAL,Template oriented programming,iDTV},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, “Semiotics,” in The encyclopedia of human-computer interaction, M. Soegaard and R. F. Dam, Eds., Aarhus, Denmark: The interaction design foundation, 2012, p. 1–35.
  [BibTeX] [Abstract] [Download PDF]
  

  This chapter covers why and how Semiotics can help advance some of the major goals of Human-Computer Interaction (HCI) and be useful when designing interactive products. It begins with brief definitions and explanations of a few central concepts in Semiotics. This is followed by a discussion of harder challenges involved in bringing Semiotics into the domain of HCI research and the consequences of viewing computers as media. Following Semiotic Engineering concepts, which we have been developing and using for two decades now, we then revisit computer-mediated communication in view of 21st century literacy issues. First, we show that basic computing skills exhibited by contemporary users are in fact semiotic engineering abilities of the same sort as required from professional designers. Then we show how these skills can leverage an individualâs participation in a variety of social processes. In conclusion, the chapter presents our personal answer to the question that most readers certainly have in mind: ‘So, whatâs in it for me?â

  @InBook{Souza2012Semiotics,
  address = {Aarhus, Denmark},
  author = {de Souza, C.S.},
  booktitle = {The Encyclopedia of Human-Computer Interaction},
  editor = {Soegaard, M. and Dam, R.F.},
  pages = {1--35},
  publisher = {The Interaction Design Foundation},
  title = {Semiotics},
  year = {2012},
  abstract = {This chapter covers why and how Semiotics can help advance some of the major goals of Human-Computer Interaction (HCI) and be useful when designing interactive products. It begins with brief definitions and explanations of a few central concepts in Semiotics. This is followed by a discussion of harder challenges involved in bringing Semiotics into the domain of HCI research and the consequences of viewing computers as media. Following Semiotic Engineering concepts, which we have been developing and using for two decades now, we then revisit computer-mediated communication in view of 21st century literacy issues. First, we show that basic computing skills exhibited by contemporary users are in fact semiotic engineering abilities of the same sort as required from professional designers. Then we show how these skills can leverage an individualâs participation in a variety of social processes. In conclusion, the chapter presents our personal answer to the question that most readers certainly have in mind: ‘So, whatâs in it for me?â},
  chapter = {25},
  keywords = {Computational Semiotics, Semiotic Engineering, HCI Theory},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://www.interaction-design.org/encyclopedia/semiotics_and_human-computer_interaction.html},
  }

• C. S. de Souza, “The semiotic turn,” Journal of visual languages and computing, vol. 23, iss. 2, p. 116–119, 2012. doi:10.1016/j.jvlc.2011.11.008
  [BibTeX] [Abstract] [Download PDF]
  

  This paper reports the author{\’}s personal collaboration with Piero Mussio. It begins with an analysis of Mussio{\’}s increasing involvement with semiotic concepts while working with visual languages. In conclusion, the author proposes follow-up questions, in continuation to an ongoing intellectual conversation that current and future researchers may help to sustain.

  @Article{Souza2012SemioticTurn,
  abstract = {This paper reports the author{\'}s personal collaboration with Piero Mussio. It begins with an analysis of Mussio{\'}s increasing involvement with semiotic concepts while working with visual languages. In conclusion, the author proposes follow-up questions, in continuation to an ongoing intellectual conversation that current and future researchers may help to sustain.},
  author = {de Souza, C.S.},
  journal = {Journal of Visual Languages and Computing},
  pages = {116--119},
  title = {The Semiotic Turn},
  volume = {23},
  year = {2012},
  doi = {10.1016/j.jvlc.2011.11.008},
  number = {2},
  url = {http://www.sciencedirect.com/science/article/pii/S1045926X11000796},
  issn = {1045-926X},
  keywords = {Computational Semiotics,Semiotic Engineering},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, “Hci education in computer science: reflections on 14 years of experience | ensino de ihc na computação: reflexões sobre 14~Anos de experiência,” in Ceur workshop proceedings, 2012, p. 1–2.
  [BibTeX] [Abstract]
  

  The purpose of this presentation is to share with the interested audience some reflections after 14 years of teaching HCI in undergraduate programs in Computer Engineering, Information Systems and Computer Science at the Department of Informatics of the Pontifical Catholic University of Rio de Janeiro. In particular, I will discuss the positioning of HCI in Informatics and the challenges of teaching it in such context. As an interdisciplinary area it must be learned, taught, researched and applied keeping in mind not only this positioning but also its relations with various other disciplines such as Ergonomics and Design, Psychology, Social Communication and many others.

  @InProceedings{Souza2012HCIEducationComputer,
  abstract = {The purpose of this presentation is to share with the interested audience some reflections after 14 years of teaching HCI in undergraduate programs in Computer Engineering, Information Systems and Computer Science at the Department of Informatics of the Pontifical Catholic University of Rio de Janeiro. In particular, I will discuss the positioning of HCI in Informatics and the challenges of teaching it in such context. As an interdisciplinary area it must be learned, taught, researched and applied keeping in mind not only this positioning but also its relations with various other disciplines such as Ergonomics and Design, Psychology, Social Communication and many others.},
  author = {de Souza, C.S.},
  booktitle = {CEUR Workshop Proceedings},
  pages = {1--2},
  title = {HCI Education in Computer Science: Reflections on 14 Years of Experience | Ensino de IHC na Computação: Reflexões Sobre 14~{A}nos de Experiência},
  year = {2012},
  volume = {967},
  issn = {1613-0073},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

2011

• S. D. J. Barbosa and C. S. de Souza, “Are hci researchers an endangered species in brazil?,” Interactions, vol. 18, iss. 3, p. 69–71, 2011. doi:10.1145/1962438.1962454
  [BibTeX] [Abstract]
  

  Public policy increasingly plays a role in influencing the work that we do as HCI researchers, interaction designers, and practitioners. {\”}Public policy{\”} is a broad term that includes both government policy and policy within non-governmental organizations, such as standards bodies. The Interacting with Public Policy forum focuses on topics at the intersection of human-computer interaction and public policy.

  @Article{Barbosa2011AreHCIResearchers,
  abstract = {Public policy increasingly plays a role in influencing the work that we do as HCI researchers, interaction designers, and practitioners. {\"}Public policy{\"} is a broad term that includes both government policy and policy within non-governmental organizations, such as standards bodies. The Interacting with Public Policy forum focuses on topics at the intersection of human-computer interaction and public policy.},
  author = {Barbosa, S.D.J. and de Souza, C.S.},
  journal = {interactions},
  pages = {69--71},
  title = {Are HCI Researchers an Endangered Species in Brazil?},
  volume = {18},
  year = {2011},
  doi = {10.1145/1962438.1962454},
  month = may,
  number = {3},
  issue_date = {May + June 2011},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• I. M. Monteiro and C. S. de Souza, “Embedded cultural features in the design of an accessibility agent for the web,” in Universal access in human-computer interaction. design for all and einclusion: 6th international conference, uahci 2011, held as part of hci international 2011, orlando, fl, usa, july 9-14, 2011, proceedings, part i, Berlin, Heidelberg, 2011, p. 295–304. doi:10.1007/978-3-642-21672-5_33
  [BibTeX] [Abstract]
  

  This paper presents the Web Navigation Helper (WNH), an interface agent for users with special needs originally developed for Brazilian users. WNH mediates scripted interaction with web sites, by providing alternative dialogs with appropriate style, structure, etc. The paper reports the results of qualitative empirical studies done at the early design stages. In particular, it shows how our design vision changed when findings from initial studies revealed that the technology we were about to develop was implicitly guided by a sociability model that was not prevalent in the Brazilian culture. The main contributions of the paper are to expose the process by which we became aware of cultural factors affecting the design of accessibility agents, and to propose a kind of technology that may be adopted in cultures whose sociability models are based on personal relations with friends and family members.

  @InProceedings{Monteiro2011EmbeddedCulturalFeatures,
  abstract = {This paper presents the Web Navigation Helper (WNH), an interface agent for users with special needs originally developed for Brazilian users. WNH mediates scripted interaction with web sites, by providing alternative dialogs with appropriate style, structure, etc. The paper reports the results of qualitative empirical studies done at the early design stages. In particular, it shows how our design vision changed when findings from initial studies revealed that the technology we were about to develop was implicitly guided by a sociability model that was not prevalent in the Brazilian culture. The main contributions of the paper are to expose the process by which we became aware of cultural factors affecting the design of accessibility agents, and to propose a kind of technology that may be adopted in cultures whose sociability models are based on personal relations with friends and family members.},
  address = {Berlin, Heidelberg},
  author = {Monteiro, Ingrid Monteiro and de Souza, Clarisse Sieckenius},
  booktitle = {Universal Access in Human-Computer Interaction. Design for All and eInclusion: 6th International Conference, UAHCI 2011, Held as Part of HCI International 2011, Orlando, FL, USA, July 9-14, 2011, Proceedings, Part I},
  editor = {Stephanidis, Constantine},
  pages = {295--304},
  publisher = {Springer Berlin Heidelberg},
  title = {Embedded Cultural Features in the Design of an Accessibility Agent for the Web},
  year = {2011},
  series = {Lecture Notes in Computer Science},
  volume = {6765},
  doi = {10.1007/978-3-642-21672-5_33},
  isbn = {978-3-642-21672-5},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• L. C. C. Salgado, C. S. de Souza, and C. F. Leitão, “Using metaphors to explore cultural perspectives in cross-cultural design,” in Hci international 2011 / internationalization, design and global development, 2011, orlando, florida. proceedings of the 4th international conference on internationalization, design and global development (idgd’11)., Berlin Heidelberg, 2011, p. 94–103. doi:10.1007/978-3-642-21660-2_11
  [BibTeX] [Abstract]
  

  We have proposed five cultural viewpoint metaphors to help designers that wish to encourage and support cross-cultural HCI contacts. In this paper we present the main results of an experiment carried out to assess the potential of these metaphors in designing cross-cultural systems. Six HCI designers, with different cultural backgrounds, were then asked to create re-design alternatives for a real website guided by the metaphors. As a result, the experiment showed the epistemic effect of the metaphors on cross-cultural design, i. e. as a means to build new knowledge and understanding.

  @InProceedings{Salgado2011UsingMetaphorsExplore,
  abstract = {We have proposed five cultural viewpoint metaphors to help designers that wish to encourage and support cross-cultural HCI contacts. In this paper we present the main results of an experiment carried out to assess the potential of these metaphors in designing cross-cultural systems. Six HCI designers, with different cultural backgrounds, were then asked to create re-design alternatives for a real website guided by the metaphors. As a result, the experiment showed the epistemic effect of the metaphors on cross-cultural design, i. e. as a means to build new knowledge and understanding.},
  address = {Berlin Heidelberg},
  author = {Salgado, L.C.C. and de Souza, C.S. and Leitão, C.F.},
  booktitle = {HCI International 2011 / Internationalization, Design and Global Development, 2011, Orlando, Florida. Proceedings of the 4th international conference on Internationalization, design and global development (IDGD'11).},
  editor = {Rau, P.L.Patrick and Rau, P.L.Patrick},
  pages = {94--103},
  publisher = {Springer},
  title = {Using Metaphors to Explore Cultural Perspectives in Cross-Cultural Design},
  year = {2011},
  series = {Lecture Notes in Computer Science},
  volume = {6775},
  doi = {10.1007/978-3-642-21660-2_11},
  isbn = {978-3-642-21659-6},
  keywords = {Culture and Human-Computer Interaction, Cross-Cultural HCI Design, Semiotic Engineering},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• L. C. C. Salgado, C. S. de Souza, and C. F. Leitão, “On the epistemic nature of cultural viewpoint metaphors,” in Proceedings of the 10th brazilian symposium on on human factors in computing systems and the 5th latin american conference on human-computer interaction ihc+clihc ‘2011, Porto de Galinhas, Pernambuco, Brazil, 2011, p. 23–32.
  [BibTeX] [Abstract] [Download PDF]
  

  This paper presents the results of a in-depth qualitative study to investigate if and how our previously proposed Cultural Viewpoint Metaphors (CVM) can support practitioners in assessing the quality of HCI design alternatives. The results of the study underline the epistemic value of CVM in cross-cultural system design processes. The metaphors have not only helped participants to organize their thinking about how cultural diversity is exposed and communicated through systems interfaces, but also to build new knowledge and understanding about culture itself.

  @InProceedings{Salgado2011EpistemicNatureCultural,
  abstract = {This paper presents the results of a in-depth qualitative study to investigate if and how our previously proposed Cultural Viewpoint Metaphors (CVM) can support practitioners in assessing the quality of HCI design alternatives. The results of the study underline the epistemic value of CVM in cross-cultural system design processes. The metaphors have not only helped participants to organize their thinking about how cultural diversity is exposed and communicated through systems interfaces, but also to build new knowledge and understanding about culture itself.},
  address = {Porto de Galinhas, Pernambuco, Brazil},
  author = {Salgado, L.C.C. and de Souza, C.S. and Leitão, C.F.},
  booktitle = {Proceedings of the 10th Brazilian Symposium on on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction IHC+CLIHC '2011},
  location = {Porto Alegre, RS},
  pages = {23--32},
  publisher = {SBC Sociedade Brasileira de Computação / ACM Association for Computing Machinery},
  title = {On the Epistemic Nature of Cultural Viewpoint Metaphors},
  year = {2011},
  series = {ACM International Conference Series},
  acmid = {2254443},
  isbn = {978-85-7669-257-7},
  keywords = {Culture and Human-Computer Interaction, Cross-Cultural HCI Design, Semiotic Engineering},
  numpages = {10},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://dl.acm.org/citation.cfm?id=2254436.2254443},
  }

• C. S. de Souza, A. C. B. Garcia, C. Slaviero, H. Pinto, and A. Repenning, “Semiotic traces of computational thinking acquisition,” in End-user development – proceedings of the third international conference on end-user development is/eud’2011, Torre Canne, Italy, 2011, p. 155–170. doi:10.1007/978-3-642-21530-8_13
  [BibTeX] [Abstract]
  

  Computational thinking involves many different abilities, including being able to represent real and imaginary worlds in highly constrained computer languages. These typically support very selective kinds of perspectives, abstractions and articulation compared to the unlimited possibilities provided by natural languages. This paper reports findings from a qualitative empirical study with novice programmers, carried out with AgentSheets in a Brazilian public school. The driving research question was: How do meanings expressed in natural language narratives relate to computational constructs expressed in programs produced by novices? We used semiotic and linguistic analysis to compare meaning representations in natural and artificial texts (game descriptions in Brazilian Portuguese and Visual AgenTalk code). We looked for recurring relations and what they might mean in the context of computational thinking education. Our findings suggest that the semiotic richness of AgentSheets can be explored to introduce different aspects of computational thinking in principled and theoretically-informed ways.

  @InProceedings{Souza2011SemioticTracesComputational,
  abstract = {Computational thinking involves many different abilities, including being able to represent real and imaginary worlds in highly constrained computer languages. These typically support very selective kinds of perspectives, abstractions and articulation compared to the unlimited possibilities provided by natural languages. This paper reports findings from a qualitative empirical study with novice programmers, carried out with AgentSheets in a Brazilian public school. The driving research question was: How do meanings expressed in natural language narratives relate to computational constructs expressed in programs produced by novices? We used semiotic and linguistic analysis to compare meaning representations in natural and artificial texts (game descriptions in Brazilian Portuguese and Visual AgenTalk code). We looked for recurring relations and what they might mean in the context of computational thinking education. Our findings suggest that the semiotic richness of AgentSheets can be explored to introduce different aspects of computational thinking in principled and theoretically-informed ways.},
  address = {Torre Canne, Italy},
  author = {de Souza, C.S. and Garcia, A.C.B. and Slaviero, C. and Pinto, H. and Repenning, A.},
  booktitle = {End-User Development - Proceedings of the Third international conference on End-user development IS/EUD'2011},
  editor = {Costabile, MariaFrancesca and Dittrich, Yvonne and Fischer, Gerhard and Piccinno, Antonio and Costabile, MariaFrancesca and Dittrich, Yvonne and Fischer, Gerhard and Piccinno, Antonio},
  location = {Torre Canne, Italy},
  pages = {155--170},
  publisher = {Springer-Verlag},
  title = {Semiotic Traces of Computational Thinking Acquisition},
  year = {2011},
  series = {Lecture Notes in Computer Science},
  volume = {6654},
  doi = {10.1007/978-3-642-21530-8_13},
  isbn = {978-3-642-21529-2},
  keywords = {Computational Thinking, Visual Programming, Discourse Analysis, Semiotic Inspection Method, Computer Languages and Notations},
  numpages = {16},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

2010

• C. S. Soares Neto, L. F. G. Soares, and C. S. de Souza, “Tal: template authoring language for hypermedia documents | tal – linguagem para autoria de templates de documentos hipermídia,” in Webmedia 2010 – anais de artigos completos do xvi simposio brasileiro de sistemas multimidia e web, 2010, p. 147–154.
  [BibTeX] [Abstract]
  

  This paper presents TAL (Template Authoring Language), an authoring language for hypermedia document templates. Templates describe document families that are structurally or semantically similar among them. TAL enables the description of a template independently of the target hypermedia authoring language. The paper also presents a TAL processor that generates complete hypermedia documents taking as input the template specification in TAL and a data file with the information that makes that document unique in its family.

  @InProceedings{SoaresNeto2010TalTemplateAuthoring,
  abstract = {This paper presents TAL (Template Authoring Language), an authoring language for hypermedia document templates. Templates describe document families that are structurally or semantically similar among them. TAL enables the description of a template independently of the target hypermedia authoring language. The paper also presents a TAL processor that generates complete hypermedia documents taking as input the template specification in TAL and a data file with the information that makes that document unique in its family.},
  author = {Soares Neto, C.S. and Soares, L.F.G. and de Souza, C.S.},
  booktitle = {WebMedia 2010 - Anais de Artigos Completos do XVI Simposio Brasileiro de Sistemas Multimidia e Web},
  pages = {147--154},
  title = {Tal: Template Authoring Language for Hypermedia Documents | Tal - Linguagem para Autoria de Templates de Documentos Hipermídia},
  year = {2010},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. Soares Neto, L. F. G. Soares, and C. S. de Souza, “The nested context language reuse features,” Journal of the brazilian computer society, vol. 16, iss. 4, p. 229–245, 2010. doi:10.1007/s13173-010-0017-z
  [BibTeX] [Abstract]
  

  NCL, the standard declarative language of the Brazilian Terrestrial Digital TV System and ITU-T Recommendation for IPTV Services, provides a high level of reuse in the design of hypermedia applications. In this paper we detail how its design and conceptual model have succeeded in supporting reuse at a declarative level. NCL supports not only static but also running code reuse. It also allows for reuse inside applications, reuse between applications, and reuse of code spans stored in external libraries. For a specification language to promote reuse, however, it must have a number of usability merits. Aspects of NCL usability are thus analyzed with the Cognitive Dimensions of Notation framework.

  @Article{SoaresNeto2010NestedContextLanguage,
  abstract = {NCL, the standard declarative language of the Brazilian Terrestrial Digital TV System and ITU-T Recommendation for IPTV Services, provides a high level of reuse in the design of hypermedia applications. In this paper we detail how its design and conceptual model have succeeded in supporting reuse at a declarative level. NCL supports not only static but also running code reuse. It also allows for reuse inside applications, reuse between applications, and reuse of code spans stored in external libraries. For a specification language to promote reuse, however, it must have a number of usability merits. Aspects of NCL usability are thus analyzed with the Cognitive Dimensions of Notation framework.},
  author = {Soares Neto, C.S. and Soares, L.F.G. and de Souza, C.S.},
  journal = {Journal of the Brazilian Computer Society},
  pages = {229--245},
  title = {The Nested Context Language Reuse Features},
  volume = {16},
  year = {2010},
  doi = {10.1007/s13173-010-0017-z},
  number = {4},
  issn = {01046500 16784804},
  issue = {4},
  keywords = {Code reuse,Cognitive Dimensions of Notation,DTV,Declarative programming,Ginga-NCL,Middleware,NCL,SBTVD-T},
  language = {English},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, C. F. Leitão, R. O. Prates, S. Amélia Bim, and E. J. da Silva, “Can inspection methods generate valid new knowledge in hci? the case of semiotic inspection,” International journal of human computer studies, vol. 68, iss. 1-2, p. 22–40, 2010. doi:10.1016/j.ijhcs.2009.08.006
  [BibTeX] [Abstract]
  

  HCI evaluation methods tend to be proposed and used to verify the interactive qualities of specific systems and design strategies. A discussion about the scientific merits of such methods to advance knowledge in HCI as a field is very rare, although much needed. This paper shows that, under certain conditions, inspection methods can be safely used in scientific research in HCI and extend their advantages beyond the territory of professional practice. Taking the Semiotic Inspection Method (SIM) as an example, we argue that its interpretive results are objective, can be validated, and produce scientific knowledge comparable to that generated by more widely accepted methods.

  @Article{Souza2010CanInspectionMethods,
  abstract = {HCI evaluation methods tend to be proposed and used to verify the interactive qualities of specific systems and design strategies. A discussion about the scientific merits of such methods to advance knowledge in HCI as a field is very rare, although much needed. This paper shows that, under certain conditions, inspection methods can be safely used in scientific research in HCI and extend their advantages beyond the territory of professional practice. Taking the Semiotic Inspection Method (SIM) as an example, we argue that its interpretive results are objective, can be validated, and produce scientific knowledge comparable to that generated by more widely accepted methods.},
  author = {de Souza, C.S. and Leitão, C.F. and Prates, R.O. and Amélia Bim, S. and da Silva, E.J.},
  journal = {International Journal of Human Computer Studies},
  pages = {22--40},
  title = {Can Inspection Methods Generate Valid New Knowledge in HCI? the Case of Semiotic Inspection},
  volume = {68},
  year = {2010},
  doi = {10.1016/j.ijhcs.2009.08.006},
  number = {1-2},
  issn = {10715819 10959300},
  keywords = {Communicability,Evaluation method,Scientific application,Semiotic Inspection Method,Semiotic engineering,Technical application},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, I. T. Monteiro, and C. Intrator, “Questões científicas, técnicas e éticas do desafio iv: reflexões sobre um assistente para a navegação na web,” in Anais do xxxvii semish, Belo Horizonte, MG, 2010, p. 463–477. doi:10/anais
  [BibTeX] [Abstract]
  

  This paper presents research on web navigation helpers aimed at users with different kinds of special needs. We discuss scientific and technical findings from empirical experiments we have done, and comment on ethical dimensions of Grand Challenge IV, posed by the Brazilian Computer Society for 2006-2016.

  @InProceedings{Souza2010QuestoesCientificasTecnicas,
  abstract = {This paper presents research on web navigation helpers aimed at users with different kinds of special needs. We discuss scientific and technical findings from empirical experiments we have done, and comment on ethical dimensions of Grand Challenge IV, posed by the Brazilian Computer Society for 2006-2016.},
  address = {Belo Horizonte, MG},
  author = {de Souza, C.S. and Monteiro, I.T. and Intrator, C.},
  booktitle = {Anais do XXXVII SEMISH},
  location = {Porto Alegre, RS},
  pages = {463--477},
  publisher = {SBC Sociedade Brasileira de Computação},
  title = {Questões Científicas, Técnicas e Éticas Do Desafio IV: Reflexões Sobre um Assistente para a Navegação na Web},
  year = {2010},
  month = jul,
  doi = {10/anais},
  keywords = {Web Accessibility, Sociability in Computer-Supported Human Interaction, Grand Challenges of the Brazilian Computer Society, Ethical Aspects in HCI Research},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

2009

• C. S. de Souza and C. F. Leitão, Semiotic engineering methods for scientific research in hci, San Rafael, CA: Morgan & claypool, 2009, vol. 2. doi:10.2200/S00173ED1V01Y200901HCI002
  [BibTeX] [Abstract]
  

  Discusses how semiotic inspection method and communicability evaluation method, which are both qualitative methods, can also be used in scientific contexts to generate knowledge about human-computer interaction. Introduction; Essence of Semiotic Engineering; Semiotic Engineering Methods; Case Study with Audacity; Lessons Learned with Semiotic Engineering Methods; The Near Future of Semiotic Engineering. [from Worldcat.org]

  @Book{Souza2009SemioticEngineeringMethods,
  address = {San Rafael, CA},
  author = {Clarisse Sieckenius de Souza and Carla Faria Leitão},
  publisher = {Morgan \& Claypool},
  title = {Semiotic Engineering Methods for Scientific Research in HCI},
  year = {2009},
  abstract = {Discusses how semiotic inspection method and communicability evaluation method, which are both qualitative methods, can also be used in scientific contexts to generate knowledge about human-computer interaction. Introduction; Essence of Semiotic Engineering; Semiotic Engineering Methods; Case Study with Audacity; Lessons Learned with Semiotic Engineering Methods; The Near Future of Semiotic Engineering. [from Worldcat.org]},
  series = {Synthesis lectures on human-centered informatics},
  volume = {2},
  doi = {10.2200/S00173ED1V01Y200901HCI002},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• L. C. C. Salgado, C. S. de Souza, and C. F. Leitão, “Conceptual metaphors for designing multi-cultural applications,” in 2009 latin american web congress – joint la-web/clihc conference, 2009, p. 105–111. doi:10.1109/LA-WEB.2009.17
  [BibTeX] [Abstract]
  

  This paper proposes a set of conceptual metaphors for the design of multi-cultural systems. The work is part of a long-term study to adapt the International Children{\’}s Digital Library for use in a Brazilian context. Results from previous studies along with Semiotic Engineering concepts have led us to propose five multi-cultural design metaphors to guide different communicative strategies that affect both designer-to-user communication and user-system communication.

  @InProceedings{Salgado2009ConceptualMetaphorsDesigning,
  abstract = {This paper proposes a set of conceptual metaphors for the design of multi-cultural systems. The work is part of a long-term study to adapt the International Children{\'}s Digital Library for use in a Brazilian context. Results from previous studies along with Semiotic Engineering concepts have led us to propose five multi-cultural design metaphors to guide different communicative strategies that affect both designer-to-user communication and user-system communication.},
  author = {Salgado, L.C.C. and de Souza, C.S. and Leitão, C.F.},
  booktitle = {2009 Latin American Web Congress - Joint LA-WEB/CLIHC Conference},
  pages = {105--111},
  title = {Conceptual Metaphors for Designing Multi-Cultural Applications},
  year = {2009},
  doi = {10.1109/LA-WEB.2009.17},
  isbn = {9780769538563},
  keywords = {Conceptual metaphors,Cultural aspects in HCI,Multi-Cultural HCI design,Semiotic engineering},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• L. Valente, C. S. de Souza, and B. Feijó, “Turn off the graphics: designing non-visual interfaces for mobile phone games,” Journal of the brazilian computer society, vol. 15, iss. 1, p. 45–58, 2009.
  [BibTeX] [Abstract]
  

  Mobile phones are a widespread platform for ICT applications because they are highly pervasive in contemporary society. Hence, we can think of mobile gaming as a serious candidate to being a prominent form of entertainment in the near future. However, most games (for computers, console and mobile devices) make extensive use of the visual medium, which tends to exclude visually-impaired users from the play. While mobile gaming could potentially reach many visually-impaired users, who are very familiar with this technology, currently there seems to be only very few alternatives for this community. In an attempt to explore new interactive possibilities for such users, this work presents an initial study on non-visual interfaces for mobile phone games. It is based on Semiotic Engineering principles, emphasizing communication through aural, tactile and gestural signs, and deliberately excluding visual information. Results include a number of issues that can be incorporated to a wider research agenda on mobile gaming accessibility, both for the visually-impaired and sighted.

  @Article{Valente2009TurnGraphicsDesigning,
  abstract = {Mobile phones are a widespread platform for ICT applications because they are highly pervasive in contemporary society. Hence, we can think of mobile gaming as a serious candidate to being a prominent form of entertainment in the near future. However, most games (for computers, console and mobile devices) make extensive use of the visual medium, which tends to exclude visually-impaired users from the play. While mobile gaming could potentially reach many visually-impaired users, who are very familiar with this technology, currently there seems to be only very few alternatives for this community. In an attempt to explore new interactive possibilities for such users, this work presents an initial study on non-visual interfaces for mobile phone games. It is based on Semiotic Engineering principles, emphasizing communication through aural, tactile and gestural signs, and deliberately excluding visual information. Results include a number of issues that can be incorporated to a wider research agenda on mobile gaming accessibility, both for the visually-impaired and sighted.},
  author = {Valente, L. and de Souza, C.S. and Feijó, B.},
  journal = {Journal of the Brazilian Computer Society},
  pages = {45--58},
  title = {Turn Off the Graphics: Designing Non-Visual Interfaces for Mobile Phone Games},
  volume = {15},
  year = {2009},
  number = {1},
  issn = {01046500 01046500},
  keywords = {Accessibility,Audio games,Haptics and gestures,Mobile non-visual games,Semiotic engineering,Visually-impaired users},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

2008

• V. Sacramento, M. Endler, and C. de Souza, “A privacy service for location-based collaboration among mobile users,” Journal of the brazilian computer society, vol. 14, iss. 4, p. 41–57, 2008.
  [BibTeX] [Abstract]
  

  The potential loss of privacy due to the use of location-based applications may be one of the greatest obstacles to their wider acceptance. Nevertheless, most research about privacy management to-date has not taken into consideration the complexity in the utilization of collaborative applications that may require users’ location sharing among participants. In this article, we propose a privacy service that helps users to maintain their privacy policy in a flexible and incremental way. We also carried out a qualitative evaluation study whose results illustrate several challenges that should be handled in the design of such a service.

  @Article{Sacramento2008PrivacyServiceLocation,
  abstract = {The potential loss of privacy due to the use of location-based applications may be one of the greatest obstacles to their wider acceptance. Nevertheless, most research about privacy management to-date has not taken into consideration the complexity in the utilization of collaborative applications that may require users' location sharing among participants. In this article, we propose a privacy service that helps users to maintain their privacy policy in a flexible and incremental way. We also carried out a qualitative evaluation study whose results illustrate several challenges that should be handled in the design of such a service.},
  author = {Sacramento, V. and Endler, M. and de Souza, C.},
  journal = {Journal of the Brazilian Computer Society},
  pages = {41--57},
  title = {A Privacy Service for Location-based Collaboration among Mobile Users},
  volume = {14},
  year = {2008},
  number = {4},
  issn = {01046500 01046500},
  keywords = {Context-aware application,Context-aware middleware,Design of a privacy service,LBS applications,Privacy},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• A. L. Sampaio and C. S. de Souza, “Usuários podem escrever especificações de sistemas? um estudo empírico com uma linguagem de script,” in Proceedings of the viii brazilian symposium on human factors in computing systems, Porto Alegre, Brazil, Brazil, 2008, p. 224–233.
  [BibTeX] [Abstract] [Download PDF]
  

  The use of information systems has grown rapidly in recent years, but the number of stakeholders has not grown at the same rate. Thus, there is a tendency to engage and empower end users in the software development process (EUD). Furthermore, users can participate in the development of additional functions to an existing system. This research focus on the creation of new functions (or extensions) in an existing web interface by specifying a series of actions. In this paper we present the results of our first study to analyse how two distinct groups of end users respond to the use of a macro language for the Web (CoScripter), while trying to represent system extensions. The study thus suggests that: (1) CoScripter is suitable for the specification of system extensions by end users, but (2) it needs some improvements in order to meet the needs of End User Development (EUD).

  @InProceedings{Sampaio2008UsuariosPodemEscrever,
  abstract = {The use of information systems has grown rapidly in recent years, but the number of stakeholders has not grown at the same rate. Thus, there is a tendency to engage and empower end users in the software development process (EUD). Furthermore, users can participate in the development of additional functions to an existing system. This research focus on the creation of new functions (or extensions) in an existing web interface by specifying a series of actions. In this paper we present the results of our first study to analyse how two distinct groups of end users respond to the use of a macro language for the Web (CoScripter), while trying to represent system extensions. The study thus suggests that: (1) CoScripter is suitable for the specification of system extensions by end users, but (2) it needs some improvements in order to meet the needs of End User Development (EUD).},
  address = {Porto Alegre, Brazil, Brazil},
  author = {Sampaio, Andréia Libório and de Souza, Clarisse Sieckenius},
  booktitle = {Proceedings of the VIII Brazilian Symposium on Human Factors in Computing Systems},
  location = {Porto Alegre, RS, Brazil},
  pages = {224--233},
  publisher = {Sociedade Brasileira de Computação},
  title = {Usuários Podem Escrever Especificações de Sistemas? Um Estudo Empírico com Uma Linguagem de Script},
  year = {2008},
  series = {IHC '08},
  acmid = {1497495},
  isbn = {978-85-7669-203-4},
  keywords = {end user development, end user programming, especificação de sistemas, extensão de sistemas, linguagens de descrição},
  numpages = {10},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://dl.acm.org/citation.cfm?id=1497470.1497495},
  }

• C. S. de Soares Neto, C. S. de Souza, and L. F. G. Soares, “Linguagens computacionais como interfaces: um estudo com nested context language,” in Proceedings of the viii brazilian symposium on human factors in computing systems, Porto Alegre, Brazil, Brazil, 2008, p. 166–175.
  [BibTeX] [Abstract] [Download PDF]
  

  This paper presents an empirical study about the Nested Context Language (NCL), which is a language developed to create multimedia documents and Interactive Digital TV (IDTV) applications for the Brazilian system. The goal was to obtain indicators of NCL usability in the generation of content for IDTV, since this language plays the role of interface language for users. Through data collected on forms filled by 220 students from various classes of training courses conducted in some states of Brazil and later analysis by a mix of qualitative and quantitative methods, some aspects were found where the NCL profile can and should be improved in order to ease the activities of content creators for IDTV, who have a heterogeneous profile and are not necessarily familiar with computer programming.

  @InProceedings{SoaresNeto2008LinguagensComputacionaiscomo,
  abstract = {This paper presents an empirical study about the Nested Context Language (NCL), which is a language developed to create multimedia documents and Interactive Digital TV (IDTV) applications for the Brazilian system. The goal was to obtain indicators of NCL usability in the generation of content for IDTV, since this language plays the role of interface language for users. Through data collected on forms filled by 220 students from various classes of training courses conducted in some states of Brazil and later analysis by a mix of qualitative and quantitative methods, some aspects were found where the NCL profile can and should be improved in order to ease the activities of content creators for IDTV, who have a heterogeneous profile and are not necessarily familiar with computer programming.},
  address = {Porto Alegre, Brazil, Brazil},
  author = {Soares Neto, Carlos de Salles and de Souza, Clarisse Sieckenius and Soares, Luiz Fernando Gomes},
  booktitle = {Proceedings of the VIII Brazilian Symposium on Human Factors in Computing Systems},
  location = {Porto Alegre, RS, Brazil},
  pages = {166--175},
  publisher = {Sociedade Brasileira de Computação},
  title = {Linguagens Computacionais como Interfaces: Um Estudo com Nested Context Language},
  year = {2008},
  series = {IHC '08},
  acmid = {1497489},
  isbn = {978-85-7669-203-4},
  keywords = {end-user programming, interactive digital TV applications, middleware Ginga, nested context language, user studies},
  numpages = {10},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://dl.acm.org/citation.cfm?id=1497470.1497489},
  }

• C. S. de Souza, “Missing links in the rhetoric of activity theory,” Interacting with computers, vol. 20, iss. 2, p. 267–271, 2008. doi:10.1016/j.intcom.2007.07.006
  [BibTeX] [Abstract]
  

  This commentary on Victor González{\’}s proposal to introduce the notion of working spheres/engagements in the traditional activity hierarchy adopts a semiotic perspective. It suggests that the benefit of the proposed introduction is rhetorical rather than strictly conceptual. Thus, the commentary focuses on the importance of distinguishing between models (or descriptions) of activities and of {\”}discourse about{\”} activities. It also illustrates some kinds of questions that might be asked and answered by virtue of such a distinction.

  @Article{Souza2008MissingLinksRhetoric,
  abstract = {This commentary on Victor Gonz{\'{a}}lez{\'}s proposal to introduce the notion of working spheres/engagements in the traditional activity hierarchy adopts a semiotic perspective. It suggests that the benefit of the proposed introduction is rhetorical rather than strictly conceptual. Thus, the commentary focuses on the importance of distinguishing between models (or descriptions) of activities and of {\"}discourse about{\"} activities. It also illustrates some kinds of questions that might be asked and answered by virtue of such a distinction.},
  author = {de Souza, C.S.},
  journal = {Interacting with Computers},
  pages = {267--271},
  title = {Missing Links in the Rhetoric of Activity Theory},
  volume = {20},
  year = {2008},
  doi = {10.1016/j.intcom.2007.07.006},
  number = {2},
  issn = {0953-5438},
  keywords = {Activity Theory,Semiotic approaches to HCI,Sign mediation},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza and A. Cypher, “Semiotic engineering in practice: redesigning the coscripter interface,” in Proceedings of the workshop on advanced visual interfaces avi, New York, NY, USA, 2008, p. 165–172. doi:10.1145/1385569.1385597
  [BibTeX] [Abstract]
  

  Semiotic Engineering uses semiotic theories to characterize human-computer interaction and support research and development of interactive systems. In order to show the value of Semiotic Engineering in design, we illustrate how semiotic concepts have been used in the analysis and generation of redesign alternatives for a web browser-based program called CoScripter. We also discuss how specific perspectives and expectations about the design process can increase the benefit from Semiotic Engineering in design activities, and describe our future steps in this research. Copyright 2008 ACM.

  @InProceedings{Souza2008SemioticEngineeringPractice,
  abstract = {Semiotic Engineering uses semiotic theories to characterize human-computer interaction and support research and development of interactive systems. In order to show the value of Semiotic Engineering in design, we illustrate how semiotic concepts have been used in the analysis and generation of redesign alternatives for a web browser-based program called CoScripter. We also discuss how specific perspectives and expectations about the design process can increase the benefit from Semiotic Engineering in design activities, and describe our future steps in this research. Copyright 2008 ACM.},
  address = {New York, NY, USA},
  author = {de Souza, C.S. and Cypher, A.},
  booktitle = {Proceedings of the Workshop on Advanced Visual Interfaces AVI},
  location = {Napoli, Italy},
  pages = {165--172},
  publisher = {ACM},
  title = {Semiotic Engineering in Practice: Redesigning the Coscripter Interface},
  year = {2008},
  series = {AVI '08},
  acmid = {1385597},
  doi = {10.1145/1385569.1385597},
  isbn = {978-1-60558-141-5},
  keywords = {End user programming,Graphical user interface design,Semiotic engineering,Ui design methodology},
  numpages = {8},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, R. F. Laffon, and C. F. Leitão, “Communicability in multicultural contexts: a study with the international children\’s digital library,” in Human-computer interaction symposium. ifip 20th world computer congress, proceedings of the 1st tc 13 human-computer interaction symposium (hcis 2008), New York, NY, 2008, p. 129–142. doi:10.1007/978-0-387-09678-0_12
  [BibTeX] [Abstract]
  

  This paper presents some contributions of semiotic engineering to the identification of cultural issues involved in the design and evaluation of multicultural systems (i.e. systems designed for users from different cultures). We carried out a communicability evaluation of the International Children{\’}s Digital Library. Participants of test sessions had different nationalities and spoke different native languages. We paid special attention to communicability problems stemming from language understanding and language use issues. Our goal was not to make generalizations from our findings, but rather to uncover and understand some of the users’ experience with multicultural systems. In addition to this understanding, we have gained relevant insights to inform the cultural adaptation of ICDL to the Brazilian context, and believe that they can be useful in other cultural contexts as well.

  @InProceedings{Souza2008CommunicabilityMulticulturalContexts,
  abstract = {This paper presents some contributions of semiotic engineering to the identification of cultural issues involved in the design and evaluation of multicultural systems (i.e. systems designed for users from different cultures). We carried out a communicability evaluation of the International Children{\'}s Digital Library. Participants of test sessions had different nationalities and spoke different native languages. We paid special attention to communicability problems stemming from language understanding and language use issues. Our goal was not to make generalizations from our findings, but rather to uncover and understand some of the users' experience with multicultural systems. In addition to this understanding, we have gained relevant insights to inform the cultural adaptation of ICDL to the Brazilian context, and believe that they can be useful in other cultural contexts as well.},
  address = {New York, NY},
  author = {de Souza, C.S. and Laffon, R. F. and Leitão, C. F.},
  booktitle = {Human-Computer Interaction Symposium. IFIP 20th World Computer Congress, Proceedings of the 1st TC 13 Human-Computer Interaction Symposium (HCIS 2008)},
  editor = {Peter Forbrig and Fabio Paternò and Annelise Mark Pejtersen},
  location = {September 7-10, 2008, Milano, Italy},
  pages = {129--142},
  publisher = {Springer US},
  title = {Communicability in Multicultural Contexts: A Study with the International Children{\'}s Digital Library},
  year = {2008},
  volume = {272},
  doi = {10.1007/978-0-387-09678-0_12},
  isbn = {9780387096773},
  issn = {1571-5736},
  keywords = {Communicability evaluation,Cultural issues,Semiotic engineering},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

2007

• C. M. A. Barbosa, R. O. Prates, and C. S. de Souza, “Identifying potential social impact of collaborative systems at design time,” in Human-computer interaction – interact 2007, Berlin Heidelberg, 2007, p. 31–44. doi:10.1007/978-3-540-74796-3_6
  [BibTeX] [Abstract]
  

  This paper presents Manas, a Semiotic Engineering epistemic tool for the design of collaborative systems (CoSys) whose aim is to expand the designers’ knowledge and awareness of their influence on groups and group dynamics. Manas has been developed to help designers represent their conception of computer-mediated communication and reflect upon some of its potential social effects, springing from user-system interaction, as well from user-user interaction (through the system). The paper illustrates how Manas can lead designers to reflect upon both the design problem and its proposed solution(s), which allows them to make more conscious decisions. Increased knowledge and awareness should then enhance the quality of CoSys design.

  @InProceedings{Barbosa2007IdentifyingPotentialSocial,
  abstract = {This paper presents Manas, a Semiotic Engineering epistemic tool for the design of collaborative systems (CoSys) whose aim is to expand the designers' knowledge and awareness of their influence on groups and group dynamics. Manas has been developed to help designers represent their conception of computer-mediated communication and reflect upon some of its potential social effects, springing from user-system interaction, as well from user-user interaction (through the system). The paper illustrates how Manas can lead designers to reflect upon both the design problem and its proposed solution(s), which allows them to make more conscious decisions. Increased knowledge and awareness should then enhance the quality of CoSys design.},
  address = {Berlin Heidelberg},
  author = {Barbosa, C. M. A. and Prates, R. O. and de Souza, C.S.},
  booktitle = {Human-Computer Interaction – INTERACT 2007},
  editor = {Cecilia Baranauskas and Philippe Palanque and Julio Abascal and Simone Barbosa},
  location = {Rio de Janeiro, Brazil, September 10-14, 2007},
  pages = {31--44},
  publisher = {Springer},
  title = {Identifying Potential Social Impact of Collaborative Systems at Design Time},
  year = {2007},
  number = {PART 1},
  series = {Lecture Notes in Computer Science},
  volume = {4662},
  doi = {10.1007/978-3-540-74796-3_6},
  isbn = {9783540747949},
  issn = {03029743 16113349},
  keywords = {Collaborative systems,Computer-mediated communication,Design models,Online communities,Semiotic engineering,Social aspects of HCI},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. F. Leitão, C. S. de Souza, and C. M. A. Barbosa, “Face-to-face sociability signs made explicit in cmc,” in Human-computer interaction – interact 2007, Berlin Heidelberg, 2007, p. 5–18. doi:10.1007/978-3-540-74796-3_4
  [BibTeX] [Abstract]
  

  This paper discusses how semiotic engineering can support the formulation of problems and solutions involved in handling face-to-face (F2F) sociability models in computer-mediated communication (CMC). Based on a case study where a group of users migrated through different types of CMC systems, we show that the designer{\’}s model of F2F sociability is extensively signified and encoded into technology, whether they know it or not. Users are deeply affected by the designers’ F2F sociability models. Two qualitative methods of analysis are used to reveal the richness of interpretive and communicative processes in which online communities are involved, and the interplay of designers’ and users’ signs at interaction time.

  @InProceedings{Leitao2007FacefaceSociability,
  abstract = {This paper discusses how semiotic engineering can support the formulation of problems and solutions involved in handling face-to-face (F2F) sociability models in computer-mediated communication (CMC). Based on a case study where a group of users migrated through different types of CMC systems, we show that the designer{\'}s model of F2F sociability is extensively signified and encoded into technology, whether they know it or not. Users are deeply affected by the designers' F2F sociability models. Two qualitative methods of analysis are used to reveal the richness of interpretive and communicative processes in which online communities are involved, and the interplay of designers' and users' signs at interaction time.},
  address = {Berlin Heidelberg},
  author = {Leitão, C. F. and de Souza, C.S. and Barbosa, C. M. A.},
  booktitle = {Human-Computer Interaction – INTERACT 2007},
  editor = {Cecilia Baranauskas and Philippe Palanque and Julio Abascal and Simone Barbosa},
  location = {Rio de Janeiro, Brazil, September 10-14, 2007},
  pages = {5--18},
  publisher = {Springer},
  title = {Face-to-face Sociability Signs Made Explicit in CMC},
  year = {2007},
  number = {PART 1},
  series = {Lecture Notes in Computer Science},
  volume = {4662},
  doi = {10.1007/978-3-540-74796-3_4},
  isbn = {9783540747949},
  issn = {03029743 16113349},
  keywords = {CMC,Semiotic engineering,Sociability models},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, “Getting your message across to your users,” in Human-computer interaction – interact 2007, Berlin Heidelberg, 2007, p. 2–3. doi:10.1007/978-3-540-74796-3_2
  [BibTeX] [Abstract]
  

  Most models, theories and perspectives in human-computer interaction focus on users communicating with systems. The very name of our discipline illustrates how pervasive is the idea that users and systems are the only relevant parties involved in the process we want to design or investigate. For over a decade, the Semiotic Engineering Research Group (SERG) has elaborated an alternative account of HCI. In it, what we traditionally call human-computer interaction is characterized as a particular instance of a more general process of computer-mediated human communication. Semiotic Engineering views HCI as a case of designer-to-user metacommunication, or communication about how to communicate (with/through the system), when and what for. The designer{\’}s metacommunication message conveyed by means of a wide range of communicative exchanges between the users and the system. The system represents designers at interaction time, and each turn of communicative exchange adds a significant piece of knowledge and experience to what eventually becomes the user{\’}s interpretation of the designer{\’}s message. Thus the metacommunication process is achieved. In this talk I will provide various examples of designer-to-user metacommunication, and discuss some of the main implications of bringing designers onto the stage where human-computer interaction takes place. I will place a special emphasis on how this alternative perspective encourages designers to express certain values, beliefs and expectations regarding the interactive artifacts they produce, compared with what is enabled and encouraged by more traditional views of HCI. Given the theme of INTERACT 2007, I will illustrate the differences with systems that clearly demand, and encode, an attitude of social responsibility from their designers and developers. I will wrap up the talk with some final considerations about the cultural roots of Semiotic Engineering, and a conjecture that HCI theories developed outside North America and Europe will reflect their proponents’ concern and engagement with remarkably different social and cultural backgrounds. Perhaps, our international community{\’}s investment in encouraging the development of such theories will foster progress of our discipline in some innovative directions.

  @InProceedings{Souza2007GettingYourMessage,
  abstract = {Most models, theories and perspectives in human-computer interaction focus on users communicating with systems. The very name of our discipline illustrates how pervasive is the idea that users and systems are the only relevant parties involved in the process we want to design or investigate. For over a decade, the Semiotic Engineering Research Group (SERG) has elaborated an alternative account of HCI. In it, what we traditionally call human-computer interaction is characterized as a particular instance of a more general process of computer-mediated human communication. Semiotic Engineering views HCI as a case of designer-to-user metacommunication, or communication about how to communicate (with/through the system), when and what for. The designer{\'}s metacommunication message conveyed by means of a wide range of communicative exchanges between the users and the system. The system represents designers at interaction time, and each turn of communicative exchange adds a significant piece of knowledge and experience to what eventually becomes the user{\'}s interpretation of the designer{\'}s message. Thus the metacommunication process is achieved. In this talk I will provide various examples of designer-to-user metacommunication, and discuss some of the main implications of bringing designers onto the stage where human-computer interaction takes place. I will place a special emphasis on how this alternative perspective encourages designers to express certain values, beliefs and expectations regarding the interactive artifacts they produce, compared with what is enabled and encouraged by more traditional views of HCI. Given the theme of INTERACT 2007, I will illustrate the differences with systems that clearly demand, and encode, an attitude of social responsibility from their designers and developers. I will wrap up the talk with some final considerations about the cultural roots of Semiotic Engineering, and a conjecture that HCI theories developed outside North America and Europe will reflect their proponents' concern and engagement with remarkably different social and cultural backgrounds. Perhaps, our international community{\'}s investment in encouraging the development of such theories will foster progress of our discipline in some innovative directions.},
  address = {Berlin Heidelberg},
  author = {de Souza, C.S.},
  booktitle = {Human-Computer Interaction – INTERACT 2007},
  editor = {Cecilia Baranauskas and Philippe Palanque and Julio Abascal and Simone Barbosa},
  location = {Rio de Janeiro, Brazil, September 10-14, 2007},
  pages = {2--3},
  publisher = {Springer},
  title = {Getting Your Message across to Your Users},
  year = {2007},
  number = {PART 1},
  volume = {4662},
  doi = {10.1007/978-3-540-74796-3_2},
  isbn = {9783540747949},
  issn = {03029743 16113349},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

2006

• L. C. C. de Salgado, S. A. Bim, and C. S. de Souza, “Comparação entre os métodos de avaliação de base cognitiva e semiótica,” in Proceedings of vii brazilian symposium on human factors in computing systems, New York, NY, USA, 2006, p. 158–167. doi:10.1145/1298023.1298045
  [BibTeX] [Abstract]
  

  In this article we present a comparative study of three methods: Cognitive Walkthrough, Heuristic Evaluation, and Communicability Evaluation. The aim of the study is to compare costs and benefits of the three, so as to inform decisions about which one to choose when time and feedback for (re)design are the most critical factors. The study was carried out as an academic exercise by graduate students in HCI. Results suggest that, of the three methods, Communicability Evaluation produces the most informative results, whereas Heuristic Evaluation is the most cost-effective.

  @InProceedings{Salgado2006Comparacaoentreos,
  abstract = {In this article we present a comparative study of three methods: Cognitive Walkthrough, Heuristic Evaluation, and Communicability Evaluation. The aim of the study is to compare costs and benefits of the three, so as to inform decisions about which one to choose when time and feedback for (re)design are the most critical factors. The study was carried out as an academic exercise by graduate students in HCI. Results suggest that, of the three methods, Communicability Evaluation produces the most informative results, whereas Heuristic Evaluation is the most cost-effective.},
  address = {New York, NY, USA},
  author = {Salgado, Luciana Cardoso de Castro and Bim, Sílvia Amélia and de Souza, Clarisse Sieckenius},
  booktitle = {Proceedings of VII Brazilian Symposium on Human Factors in Computing Systems},
  location = {Natal, RN, Brazil},
  pages = {158--167},
  publisher = {ACM},
  title = {Comparação entre os Métodos de Avaliação de Base Cognitiva e Semiótica},
  year = {2006},
  series = {IHC '06},
  acmid = {1298045},
  doi = {10.1145/1298023.1298045},
  isbn = {1-59593-432-4},
  keywords = {HCI inspection methods, communicability evaluation, evaluation methods, semiotic engineering},
  numpages = {10},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, Semiotic engineering – a new paradigm for designing interactive systems, , 2006, vol. 214. doi:10.1007/978-0-387-34732-5_21
  [BibTeX] [Abstract]
  

  This paper presents semiotic engineering – a semiotic theory of HCI. The theory has the advantage to integrate back end and front end design and development perspectives into a single metacommunication process that affects the user{\’}s experience and, ultimately, the success of any system. By means of illustrative examples, we show the kinds of effects that can be achieved with the theory, and discuss why a semiotic perspective is relevant for the future of information systems.

  @Book{Souza2006SemioticEngineeringNew,
  author = {de Souza, C.S.},
  title = {Semiotic Engineering - A New Paradigm for Designing Interactive Systems},
  year = {2006},
  abstract = {This paper presents semiotic engineering - a semiotic theory of HCI. The theory has the advantage to integrate back end and front end design and development perspectives into a single metacommunication process that affects the user{\'}s experience and, ultimately, the success of any system. By means of illustrative examples, we show the kinds of effects that can be achieved with the theory, and discuss why a semiotic perspective is relevant for the future of information systems.},
  volume = {214},
  booktitle = {IFIP International Federation for Information Processing},
  doi = {10.1007/978-0-387-34732-5_21},
  isbn = {0387346317 | 9780387346311},
  issn = {1571-5736},
  owner = {SERG},
  pages = {231--242},
  timestamp = {2020-10-21},
  }

• C. S. de Souza and S. D. J. Barbosa., “A semiotic framing for end-user development,” in End user development, H. Lieberman, F. Paternò, and V. Wulf, Eds., Dordrecht: Springer, 2006, p. 401–426. doi:10.1007/1-4020-5386-X_18
  [BibTeX] [Abstract]
  

  One approach to designing usable and enjoyable computer applications is to say that designers need better methods and tools to understand users and their contexts, and to encode this understanding into closed computer systems. Another is to acknowledge that there will always be unattended user needs, and that the way to increase usersâ satisfaction is to help them modify systems in order to meet constantly changing requirements. Different techniques are proposed in one approach usually without reference to the other. We present an overarching perspective of human-computer interactionwhere both meet, and provide a semiotic characterization of designersâ and usersâ activities that clarifies the tradeoffs involved in designing and choosing techniques in either approach. Central to this characterization is the role of intentions in what users mean to say and do when using computers. Our characterization is in line with a broader concept of usability, in which systems must support usersâ improvisation and creativity.

  @InBook{Souza2006SemioticFramingEnd,
  address = {Dordrecht},
  author = {de Souza, C.S. and Barbosa., S. D. J.},
  booktitle = {End User Development},
  editor = {Lieberman, Henry and Paternò, Fabio and Wulf, Volker},
  pages = {401--426},
  publisher = {Springer},
  title = {A Semiotic Framing for End-User Development},
  year = {2006},
  abstract = {One approach to designing usable and enjoyable computer applications is to say that designers need better methods and tools to understand users and their contexts, and to encode this understanding into closed computer systems. Another is to acknowledge that there will always be unattended user needs, and that the way to increase usersâ satisfaction is to help them modify systems in order to meet constantly changing requirements. Different techniques are proposed in one approach usually without reference to the other. We present an overarching perspective of human-computer interactionwhere both meet, and provide a semiotic characterization of designersâ and usersâ activities that clarifies the tradeoffs involved in designing and choosing techniques in either approach. Central to this characterization is the role of intentions in what users mean to say and do when using computers. Our characterization is in line with a broader concept of usability, in which systems must support usersâ improvisation and creativity.},
  doi = {10.1007/1-4020-5386-X_18},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, C. F. Leitão, R. O. Prates, and E. J. da Silva, “The semiotic inspection method,” in Proceedings of vii brazilian symposium on human factors in computing systems, New York, NY, USA, 2006, p. 148–157. doi:10.1145/1298023.1298044
  [BibTeX] [Abstract]
  

  This paper describes semiotic inspection, a semiotic engineering evaluation method. It briefly identifies the essence of theory-based evaluation methods in HCI. Then it provides a detailed description and illustration of this method, which is based on a semiotic theory of HCI. It discusses its theoretical stance in semiotic engineering compared to the communicability evaluation method, as well as the perceived advantages and disadvantages of semiotic inspection. Finally, it points at the next steps in the semiotic inspection research agenda.

  @InProceedings{Souza2006SemioticInspectionMethod,
  abstract = {This paper describes semiotic inspection, a semiotic engineering evaluation method. It briefly identifies the essence of theory-based evaluation methods in HCI. Then it provides a detailed description and illustration of this method, which is based on a semiotic theory of HCI. It discusses its theoretical stance in semiotic engineering compared to the communicability evaluation method, as well as the perceived advantages and disadvantages of semiotic inspection. Finally, it points at the next steps in the semiotic inspection research agenda.},
  address = {New York, NY, USA},
  author = {de Souza, Clarisse Sieckenius and Leitão, Carla Faria and Prates, Raquel Oliveira and da Silva, Elton José},
  booktitle = {Proceedings of VII Brazilian Symposium on Human Factors in Computing Systems},
  location = {Natal, RN, Brazil},
  pages = {148--157},
  publisher = {ACM},
  title = {The Semiotic Inspection Method},
  year = {2006},
  series = {IHC '06},
  acmid = {1298044},
  doi = {10.1145/1298023.1298044},
  isbn = {1-59593-432-4},
  keywords = {evaluation/methodology, inspection methods, qualitative methods, semiotic engineering},
  numpages = {10},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, “Da (s) subjetividade (s) na produção de tecnologia,” in Cabeças Digitais: O cotidiano na era da informação, A. M. Nicolaci-da-Costa, Ed., Rio de Janeiro, RJ: Puc-rio/loyola, 2006, p. 81–106.
  [BibTeX] [Abstract]
  

  Neste trabalho pretendemos apresentar argumentos a favor de uma frente multidisciplinar que tome por objeto de estudo as subjetividades que atuam na “produção”, e não apenas no “consumo”, de TIC. Utilizamos essencialmente três bases para sustentar o argumento: o trabalho de B. J. Fogg (2003) sobre tecnologias persuasivas; nossa própria Engenharia Semiótica (de Souza, 2005); e a recente re-edição do famoso “The Second Self” de Turkle (2005). Este tripé é ele mesmo multidisciplinar, de vez que o trabalho de Fogg se desenvolve na fronteira entre a Teoria da Comunicação e a Filosofia, a Engenharia Semiótica reúne a Informática e a Semiótica, e o trabalho de Turkle versa sobre as relações psicológicas que se verificam entre as pessoas e (seus) computadores. Ilustramos os aspectos subjetivos da produção tecnológica por meio de exemplos reais, escolhidos entre os softwares usados para tocar CD. Concluímos o artigo com uma discussão sobre os potenciais benefícios de uma caracterização adequada dos aspectos subjetivos da produção tecnológica, alinhando-nos com aqueles que defendem abertamente a multidisciplinaridade como meio de progresso científico e tecnológico.

  @InCollection{Souza2006Dassubjetividade,
  abstract = {Neste trabalho pretendemos apresentar argumentos a favor de uma frente multidisciplinar que tome por objeto de estudo as subjetividades que atuam na “produção”, e não apenas no “consumo”, de TIC. Utilizamos essencialmente três bases para sustentar o argumento: o trabalho de B. J. Fogg (2003) sobre tecnologias persuasivas; nossa própria Engenharia Semiótica (de Souza, 2005); e a recente re-edição do famoso “The Second Self” de Turkle (2005). Este tripé é ele mesmo multidisciplinar, de vez que o trabalho de Fogg se desenvolve na fronteira entre a Teoria da Comunicação e a Filosofia, a Engenharia Semiótica reúne a Informática e a Semiótica, e o trabalho de Turkle versa sobre as relações psicológicas que se verificam entre as pessoas e (seus) computadores. Ilustramos os aspectos subjetivos da produção tecnológica por meio de exemplos reais, escolhidos entre os softwares usados para tocar CD. Concluímos o artigo com uma discussão sobre os potenciais benefícios de uma caracterização adequada dos aspectos subjetivos da produção tecnológica, alinhando-nos com aqueles que defendem abertamente a multidisciplinaridade como meio de progresso científico e tecnológico.},
  address = {Rio de Janeiro, RJ},
  author = {Clarisse Sieckenius de Souza},
  booktitle = {{Cabe{\c{c}}as Digitais: O cotidiano na era da informa{\c{c}}{\~a}o}},
  editor = {Ana Maria {Nicolaci-da-Costa}},
  pages = {81--106},
  publisher = {PUC-Rio/Loyola},
  title = {{Da (s) subjetividade (s) na produ{\c{c}}{\~a}o de tecnologia}},
  year = {2006},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

2005

• C. M. D. A. Barbosa, R. O. Prates, and C. S. de Souza, “Marq-g*: a semiotic engineering approach for supporting the design of multi-user applications,” in Acm international conference proceeding series, New York, NY, USA, 2005, p. 128–138. doi:10.1145/1111360.1111373
  [BibTeX] [Abstract]
  

  This paper presents MArq-G*, a semiotic engineering epistemic tool for the design of multi-user applications that leverages the designers’ knowledge about the influence such applications may have on group dynamics and development. More precisely, MArq-G*is a conceptual architecture model for multi-user application design-support tools. It has been devised to help designers express part of their vision and rationale about group communication processes, as well as reflect upon potential consequences of their design decisions. The paper illustrates how MArq-G*enables different insights from those motivated by the use of task-based models in design. Moreover, a contrast with insights enabled by design ontologies inspired by speech act theory shows how MArq-G*supports new kinds of perspectives on multi-user applications.

  @InProceedings{Barbosa2005Marqg*Semiotic,
  abstract = {This paper presents MArq-G*, a semiotic engineering epistemic tool for the design of multi-user applications that leverages the designers' knowledge about the influence such applications may have on group dynamics and development. More precisely, MArq-G*is a conceptual architecture model for multi-user application design-support tools. It has been devised to help designers express part of their vision and rationale about group communication processes, as well as reflect upon potential consequences of their design decisions. The paper illustrates how MArq-G*enables different insights from those motivated by the use of task-based models in design. Moreover, a contrast with insights enabled by design ontologies inspired by speech act theory shows how MArq-G*supports new kinds of perspectives on multi-user applications.},
  address = {New York, NY, USA},
  author = {Barbosa, C.M.D.A. and Prates, R.O. and de Souza, C.S.},
  booktitle = {ACM International Conference Proceeding Series},
  location = {Cuernavaca, Mexico},
  pages = {128--138},
  publisher = {ACM},
  title = {Marq-g*: A Semiotic Engineering Approach for Supporting the Design of Multi-User Applications},
  year = {2005},
  series = {CLIHC '05},
  volume = {124},
  acmid = {1111373},
  doi = {10.1145/1111360.1111373},
  isbn = {1595932240 | 9781595932242},
  keywords = {design impacts,feedback on design,group communication processes,multi-user applications,semiotic engineering},
  numpages = {11},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• A. M. Pontes, C. S. de Souza, and S. D. J. Barbosa, “Organização conversacional: inspeção das representações na wikipedia,” in Proceedings of the 2005 latin american conference on human-computer interaction, New York, NY, USA, 2005, p. 235–245. doi:10.1145/1111360.1111384
  [BibTeX] [Abstract]
  

  Neste trabalho analisamos uma ferramenta do tipo Wiki, chamada WikiPedia. Nesta análise mostramos como os designers desta ferramenta criam seus sistemas de significação e como os usuários apropriam-se deste sistema de signos e criam, a partir das suas interpretações e das restrições impostas pelos designers, seus próprios sistemas de significação. O foco da análise recaiu na representação de signos voltados à caracterização de uma conversa. Esta caracterização permitiu, além de um olhar mais especifico em relação aos sistemas de signos da WikiPedia, uma classificação genérica de sistemas de apoio à participação em discussões (SAPD{\’}s ).

  @InProceedings{Pontes2005OrganizacaoConversacionalInspecao,
  abstract = {Neste trabalho analisamos uma ferramenta do tipo Wiki, chamada WikiPedia. Nesta an{\'a}lise mostramos como os designers desta ferramenta criam seus sistemas de significa{\cc}{\~a}o e como os usu{\'a}rios apropriam-se deste sistema de signos e criam, a partir das suas interpreta{\cc}{\~o}es e das restri{\cc}{\~o}es impostas pelos designers, seus pr{\'o}prios sistemas de significa{\cc}{\~a}o. O foco da an{\'a}lise recaiu na representa{\cc}{\~a}o de signos voltados {\`a} caracteriza{\cc}{\~a}o de uma conversa. Esta caracteriza{\cc}{\~a}o permitiu, al{\'e}m de um olhar mais especifico em rela{\cc}{\~a}o aos sistemas de signos da WikiPedia, uma classifica{\cc}{\~a}o gen{\'e}rica de sistemas de apoio {\`a} participa{\cc}{\~a}o em discuss{\~o}es (SAPD{\'}s ).},
  address = {New York, NY, USA},
  author = {Pontes, Adéle Malta and de Souza, Clarisse Sieckenius and Barbosa, Simone Diniz Junqueira},
  booktitle = {Proceedings of the 2005 Latin American Conference on Human-computer Interaction},
  location = {Cuernavaca, Mexico},
  pages = {235--245},
  publisher = {ACM},
  title = {Organização Conversacional: Inspeção das Representações na Wikipedia},
  year = {2005},
  series = {CLIHC '05},
  acmid = {1111384},
  doi = {10.1145/1111360.1111384},
  isbn = {1-59593-224-0},
  keywords = {WikiPedia, engenharia semiótica, organização conversacional, sistema de significação},
  numpages = {11},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, “Semiotic engineering: bringing designers and users together at interaction time,” Interacting with computers, vol. 17, iss. 3, p. 317–341, 2005. doi:10.1016/j.intcom.2005.01.007
  [BibTeX] [Abstract] [Download PDF]
  

  Semiotic engineering is a semiotic theory of human–computer interaction, where interactive computer systems are viewed as one-shot messages sent from designers to users. Through the system’s interface, in many direct and indirect ways, designers are telling the users how they can, should, or must interact with the system in order to achieve a particular range of goals anticipated at design time. Designers are thus active interlocutors at human–computer interaction time. Their interactive discourse is delivered implicitly and/or explicitly by the system, which constitutes the designer’s deputy. The importance of bringing designers and users together at interaction time springs from the intellectual nature of software artifacts. They are the result of human reasoning, choice and decision, rather than the direct effect of universal or natural laws. An adequate understanding of interactive artifacts depends on apprehending and comprehending the human intellect in action. Hence, in addition to producing interactive artifacts, designers must also introduce them appropriately, as is the case of other intellectual products. In this paper, we show how semiotic engineering can provide substantial theoretic support for viewing and exploring design possibilities brought about by this shift in perspective. We also discuss ontological and epistemological aspects of the theory, and conclude that it can bridge some of the gaps between other fragmented HCI theories and approaches.

  @Article{Souza2005SemioticEngineeringBringing,
  abstract = {Semiotic engineering is a semiotic theory of human–computer interaction, where interactive computer systems are viewed as one-shot messages sent from designers to users. Through the system's interface, in many direct and indirect ways, designers are telling the users how they can, should, or must interact with the system in order to achieve a particular range of goals anticipated at design time. Designers are thus active interlocutors at human–computer interaction time. Their interactive discourse is delivered implicitly and/or explicitly by the system, which constitutes the designer's deputy. The importance of bringing designers and users together at interaction time springs from the intellectual nature of software artifacts. They are the result of human reasoning, choice and decision, rather than the direct effect of universal or natural laws. An adequate understanding of interactive artifacts depends on apprehending and comprehending the human intellect in action. Hence, in addition to producing interactive artifacts, designers must also introduce them appropriately, as is the case of other intellectual products. In this paper, we show how semiotic engineering can provide substantial theoretic support for viewing and exploring design possibilities brought about by this shift in perspective. We also discuss ontological and epistemological aspects of the theory, and conclude that it can bridge some of the gaps between other fragmented HCI theories and approaches.},
  author = {Clarisse Sieckenius de Souza},
  journal = {Interacting with Computers},
  pages = {317--341},
  title = {Semiotic Engineering: Bringing Designers and Users Together at Interaction Time},
  volume = {17},
  year = {2005},
  doi = {10.1016/j.intcom.2005.01.007},
  number = {3},
  url = {http://www.sciencedirect.com/science/article/pii/S0953543805000202},
  issn = {0953-5438},
  keywords = {Semiotic engineering, Semiotic approaches to HCI, Epistemic support for design, Users as designers},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, The semiotic engineering of human-computer interaction, Cambridge, MA: The mit press, 2005.
  [BibTeX] [Abstract] [Download PDF]
  

  In The Semiotic Engineering of Human-Computer Interaction, Clarisse Sieckenius de Souza proposes an account of HCI that draws on concepts from semiotics and computer science to investigate the relationship between user and designer. Semiotics is the study of signs, and the essence of semiotic engineering is the communication between designers and users at interaction time; designers must somehow be present in the interface to tell users how to use the signs that make up a system or program. This approach, which builds on – but goes further than – the currently dominant user-centered approach, allows designers to communicate their overall vision and therefore helps users understand designs – rather than simply which icon to click. According to de Souza{\’}s account, both designers and users are interlocutors in an overall communication process that takes place through an interface of words, graphics, and behavior. Designers must tell users what they mean by the artifact they have created, and users must understand and respond to what they are being told. By coupling semiotic theory and engineering, de Souza{\’}s approach to HCI design encompasses the principles, the materials, the processes, and the possibilities for producing meaningful interactive computer system discourse and achieves a broader perspective than cognitive, ethnographic, or ergonomic approaches. de Souza begins with a theoretical overview and detailed exposition of the semiotic engineering account of HCI. She then shows how this approach can be applied specifically to HCI evaluation and design of online help systems, customization and end-user programming, and multiuser applications. Finally, she reflects on the potential and opportunities for research in semiotic engineering.

  @Book{Souza2005SemioticEngineeringHuman,
  address = {Cambridge, MA},
  author = {de Souza, Clarisse Sieckenius},
  publisher = {The MIT Press},
  title = {The Semiotic Engineering of Human-Computer Interaction},
  year = {2005},
  abstract = {In The Semiotic Engineering of Human-Computer Interaction, Clarisse Sieckenius de Souza proposes an account of HCI that draws on concepts from semiotics and computer science to investigate the relationship between user and designer. Semiotics is the study of signs, and the essence of semiotic engineering is the communication between designers and users at interaction time; designers must somehow be present in the interface to tell users how to use the signs that make up a system or program. This approach, which builds on -- but goes further than -- the currently dominant user-centered approach, allows designers to communicate their overall vision and therefore helps users understand designs -- rather than simply which icon to click.
  According to de Souza{\'}s account, both designers and users are interlocutors in an overall communication process that takes place through an interface of words, graphics, and behavior. Designers must tell users what they mean by the artifact they have created, and users must understand and respond to what they are being told. By coupling semiotic theory and engineering, de Souza{\'}s approach to HCI design encompasses the principles, the materials, the processes, and the possibilities for producing meaningful interactive computer system discourse and achieves a broader perspective than cognitive, ethnographic, or ergonomic approaches.
  de Souza begins with a theoretical overview and detailed exposition of the semiotic engineering account of HCI. She then shows how this approach can be applied specifically to HCI evaluation and design of online help systems, customization and end-user programming, and multiuser applications. Finally, she reflects on the potential and opportunities for research in semiotic engineering.},
  series = {Acting with Technology},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {https://mitpress.mit.edu/books/semiotic-engineering-human-computer-interaction},
  }

2004

• C. S. de Souza, A. M. Nicolaci-da-Costa, E. J. da Silva, and R. O. Prates, “Compulsory institutionalization: investigating the paradox of computer-supported informal social processes,” Interacting with computers, vol. 16, iss. 4, p. 635–656, 2004. doi:10.1016/j.intcom.2004.07.003
  [BibTeX] [Abstract]
  

  The nature and depth of technological interference on social activities online are not fully understood. We discuss one such type of interference—compulsory institutionalization, the process by which non-institutionalized face-to-face informal groups, who typically adopt implicit norms tacitly accepted by members, must create a set of explicit group structuring rules with very specific computer-encoded meanings and abide by them when they migrate to online group environments. In societies where rules can be bypassed in view of more highly valued social norms, like the Brazilian society, compulsory institutionalization may undermine experiences that are highly valued to face-to-face groups. In this article, we contrast the findings of our study with a Brazilian group of potential groupware users and those of our semiotic inspection of YahooGroups, SmartGroups and MSN Groups. We show how the systems may frustrate the group’s expectations and limit their interaction online. Reflecting on the causes and consequences of compulsory institutionalization, we conclude that the social–technical gap in group technologies may not be possible to bridge completely, and that the fulcrum of scientific research in this area may include some new aspects.

  @Article{Souza2004CompulsoryInstitutionalizationInvestigating,
  abstract = {The nature and depth of technological interference on social activities online are not fully understood. We discuss one such type of interference—compulsory institutionalization, the process by which non-institutionalized face-to-face informal groups, who typically adopt implicit norms tacitly accepted by members, must create a set of explicit group structuring rules with very specific computer-encoded meanings and abide by them when they migrate to online group environments. In societies where rules can be bypassed in view of more highly valued social norms, like the Brazilian society, compulsory institutionalization may undermine experiences that are highly valued to face-to-face groups. In this article, we contrast the findings of our study with a Brazilian group of potential groupware users and those of our semiotic inspection of YahooGroups, SmartGroups and MSN Groups. We show how the systems may frustrate the group's expectations and limit their interaction online. Reflecting on the causes and consequences of compulsory institutionalization, we conclude that the social–technical gap in group technologies may not be possible to bridge completely, and that the fulcrum of scientific research in this area may include some new aspects.},
  author = {de Souza, Clarisse Sieckenius and Nicolaci-da-Costa, Ana Maria and da Silva, Elton José and Prates, Raquel Oliveira},
  journal = {Interacting with Computers},
  pages = {635--656},
  title = {Compulsory Institutionalization: Investigating the Paradox of Computer-Supported Informal Social Processes},
  volume = {16},
  year = {2004},
  doi = {10.1016/j.intcom.2004.07.003},
  number = {4},
  eprint = {/oup/backfile/content ₍p)ublic/journal/iwc/16/4/10.1016 ⱼ.intcom.2004.07.003/3/iwc16-0635.pdf},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza and J. Preece, “A framework for analyzing and understanding online communities,” Interacting with computers, vol. 16, iss. 3, p. 579–610, 2004. doi:10.1016/j.intcom.2003.12.006
  [BibTeX] [Abstract] [Download PDF]
  

  Social interactions in online communities are varied and often complex, as are the communities themselves. The characteristics of the people, the range of purposes they pursue, the type of governance policies they develop, and the design of the software supporting a community, vary from community to community. These characteristics determine a community{\’}s sociability. Thus, the availability of powerful analytic tools to help designers understand existing technology-supported social activity online can broaden the spectrum of design knowledge and promote new insights for designing computer applications of this sort. In this paper, we present one such analytic tool – a theoretically-based online community framework (OCF). In order to demonstrate the efficacy of the framework we elaborate on its communication constituent using semiotic theory to help us. This constituent is particularly important in the OCF because it addresses computer-mediated communication between community members, and also communication from interactive software designers to users via the software they design. This latter kind of communication can shape the community{\’}s experience to a considerable extent, as our analysis shows. The paper ends with an agenda for future research.

  @Article{Souza2004FrameworkAnalyzingUnderstanding,
  abstract = {Social interactions in online communities are varied and often complex, as are the communities themselves. The characteristics of the people, the range of purposes they pursue, the type of governance policies they develop, and the design of the software supporting a community, vary from community to community. These characteristics determine a community{\'}s sociability. Thus, the availability of powerful analytic tools to help designers understand existing technology-supported social activity online can broaden the spectrum of design knowledge and promote new insights for designing computer applications of this sort. In this paper, we present one such analytic tool - a theoretically-based online community framework (OCF). In order to demonstrate the efficacy of the framework we elaborate on its communication constituent using semiotic theory to help us. This constituent is particularly important in the OCF because it addresses computer-mediated communication between community members, and also communication from interactive software designers to users via the software they design. This latter kind of communication can shape the community{\'}s experience to a considerable extent, as our analysis shows. The paper ends with an agenda for future research.},
  author = {de Souza, C.S. and Preece, J.},
  journal = {Interacting with Computers},
  pages = {579--610},
  title = {A Framework for Analyzing and Understanding Online Communities},
  volume = {16},
  year = {2004},
  doi = {10.1016/j.intcom.2003.12.006},
  number = {3},
  url = {http://www.sciencedirect.com/science/article/pii/S0953543804000232},
  issn = {0953-5438},
  keywords = {Framework,Online community,Semiotic engineering,Sociability,Usability},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

2003

• E. J. da Silva, C. S. de Souza, R. O. Prates, and A. M. Nicolaci-da-costa, “What they want and what they get: a study of light-weight technologies for online communities,” in Acm international conference proceeding series, New York, NY, USA, 2003, p. 135–146.
  [BibTeX] [Abstract] [Download PDF]
  

  In this paper, we analyze some mismatches between what is offered by light-weight technologies that support online communities and the dreams and fears of a group of 20 potential users of such technologies. In our study, members of an academic community that does not have an online extension answered an open-ended questionnaire. The answers revealed some of their expectations about group applications. With these expectations in mind, we carried out a semiotic inspection of three popular applications. Within the specific range of topics covered in the study, our findings show three important factors that seem to determine the distance between what they expect and what they get: (a) technological resources are limited, but this can be substantially improved with broad band technologies; (b) some design decisions are questionable, and should be revised; And (c) online groups must all be structured and governed by some strict rules, regardless of how informal and loose they might be offline. Factor (c), in particular, seems to be tied to deeper scientific issues involved in the inherent social-technical gap of computer technologies for groups.

  @InProceedings{Silva2003WhatTheyWant,
  abstract = {In this paper, we analyze some mismatches between what is offered by light-weight technologies that support online communities and the dreams and fears of a group of 20 potential users of such technologies. In our study, members of an academic community that does not have an online extension answered an open-ended questionnaire. The answers revealed some of their expectations about group applications. With these expectations in mind, we carried out a semiotic inspection of three popular applications. Within the specific range of topics covered in the study, our findings show three important factors that seem to determine the distance between what they expect and what they get: (a) technological resources are limited, but this can be substantially improved with broad band technologies; (b) some design decisions are questionable, and should be revised; And (c) online groups must all be structured and governed by some strict rules, regardless of how informal and loose they might be offline. Factor (c), in particular, seems to be tied to deeper scientific issues involved in the inherent social-technical gap of computer technologies for groups.},
  address = {New York, NY, USA},
  author = {da Silva, E.J. and de Souza, C.S. and Prates, R.O. and Nicolaci-da-costa, A.M.},
  booktitle = {ACM International Conference Proceeding Series},
  location = {Rio de Janeiro, Brazil},
  pages = {135--146},
  publisher = {ACM},
  title = {What They Want and What They Get: A Study of Light-Weight Technologies for Online Communities},
  year = {2003},
  series = {CLIHC '03},
  volume = {46},
  acmid = {944534},
  keywords = {Group applications,Online communities,Semiotic inspection.,Social-technical gaps in computer technologies,Underlying discourse unveiling method (UDUM)},
  numpages = {12},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://dl.acm.org/citation.cfm?id=944519.944534},
  }

• M. S. Silveira, C. S. de Souza, and S. D. J. Barbosa, “A method of semiotic engineering for the online help systems construction | um método da engenharia semiótica para a construção de sistemas de ajuda online,” in Acm international conference proceeding series, New York, NY, USA, 2003, p. 167–177.
  [BibTeX] [Abstract] [Download PDF]
  

  Online help systems are typically used (if at all) as a last resource in interactive breakdown situations. In this paper, we present a semiotic engineering method for building online help that uses fairly known design models. We discuss the benefits of having designers explicitly communicate their design vision to users and the need or opportunity to foster new cultural attitudes towards online help. We show how, as a direct communication channel from designers to users, it opens new possibilities for interaction that can be skillfully used by designers. By exploring such possibilities, designers and users may bring about more positive attitudes towards online help and counter the feeling of technological exclusion which many users express.

  @InProceedings{Silveira2003MethodSemioticEngineering,
  abstract = {Online help systems are typically used (if at all) as a last resource in interactive breakdown situations. In this paper, we present a semiotic engineering method for building online help that uses fairly known design models. We discuss the benefits of having designers explicitly communicate their design vision to users and the need or opportunity to foster new cultural attitudes towards online help. We show how, as a direct communication channel from designers to users, it opens new possibilities for interaction that can be skillfully used by designers. By exploring such possibilities, designers and users may bring about more positive attitudes towards online help and counter the feeling of technological exclusion which many users express.},
  address = {New York, NY, USA},
  author = {Silveira, M.S. and de Souza, C.S. and Barbosa, S.D.J.},
  booktitle = {ACM International Conference Proceeding Series},
  location = {Rio de Janeiro, Brazil},
  pages = {167--177},
  publisher = {ACM},
  title = {A Method of Semiotic Engineering for the Online Help Systems Construction | Um Método da Engenharia Semiótica para a Construção de Sistemas de Ajuda Online},
  year = {2003},
  series = {CLIHC '03},
  volume = {46},
  acmid = {944537},
  keywords = {Design models,HCI design,Online help systems,Semiotic engineering,Technology adoption},
  numpages = {11},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {http://dl.acm.org/citation.cfm?id=944519.944537},
  }

• C. S. de Souza, R. O. Prates, and S. D. J. Barbosa, “Adopting information technology as a first step in design,” Interactions, vol. 10, iss. 2, p. 72–79, 2003. doi:10.1145/637848.637865
  [BibTeX] [Abstract]
  

  Lessons learned from working with Brazilian social volunteers

  @Article{Souza2003AdoptingInformationTechnology,
  abstract = {Lessons learned from working with Brazilian social volunteers},
  author = {de Souza, Clarisse S. and Prates, Raquel O. and Barbosa, Simone D. J.},
  journal = {interactions},
  pages = {72--79},
  title = {Adopting Information Technology As a First Step in Design},
  volume = {10},
  year = {2003},
  doi = {10.1145/637848.637865},
  month = mar,
  number = {2},
  acmid = {637865},
  address = {New York, NY, USA},
  issn = {1072-5520},
  issue_date = {March + April 2003},
  numpages = {8},
  owner = {SERG},
  publisher = {ACM},
  timestamp = {2020-10-21},
  }

2002

• J. Preece, P. Resnick, D. Schuler, and C. S. de Souza, “What\’s sigchi\’s role in strengthening communities?,” in Conference on human factors in computing systems – proceedings, New York, NY, USA, 2002, p. 566–567. doi:10.1145/506443.506485
  [BibTeX] [Abstract]
  

  On September 11 we saw how a tightly knit group worked together to penetrate the US and carry out a carefully orchestrated attack on the World Trade Center and Pentagon. We also saw how citizens spontaneously organized themselves to care for victims and their families, and support each other. How can the CHI community build on its knowledge of computer-mediated communication and socio-technical systems design to build a more cooperative society? The aim of this discussion is to develop a research and action agenda for CHI that strengthens communities locally, nationally and internationally. The underlying premise is that such socio-technical systems can be assessed and improved so that they more effectively facilitate information exchange, emotional support, and consensus building.

  @InProceedings{Preece2002WhatsSigchisRole,
  abstract = {On September 11 we saw how a tightly knit group worked together to penetrate the US and carry out a carefully orchestrated attack on the World Trade Center and Pentagon. We also saw how citizens spontaneously organized themselves to care for victims and their families, and support each other. How can the CHI community build on its knowledge of computer-mediated communication and socio-technical systems design to build a more cooperative society? The aim of this discussion is to develop a research and action agenda for CHI that strengthens communities locally, nationally and internationally. The underlying premise is that such socio-technical systems can be assessed and improved so that they more effectively facilitate information exchange, emotional support, and consensus building.},
  address = {New York, NY, USA},
  author = {Preece, J. and Resnick, P. and Schuler, D. and de Souza, C.S.},
  booktitle = {Conference on Human Factors in Computing Systems - Proceedings},
  location = {Minneapolis, Minnesota, USA},
  pages = {566--567},
  publisher = {ACM},
  title = {What{\'}s Sigchi{\'}s Role in Strengthening Communities?},
  year = {2002},
  series = {CHI EA '02},
  acmid = {506485},
  doi = {10.1145/506443.506485},
  isbn = {1-58113-454-1},
  keywords = {Community,Sociability,Social capital,Socio-technical systems,Trust,Universal usability},
  numpages = {2},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

2001

• S. D. J. Barbosa and C. S. de Souza, “Extending software through metaphors and metonymies,” Knowledge-based systems, vol. 14, iss. 1-2, p. 15–27, 2001. doi:10.1016/S0950-7051(00)00104-0
  [BibTeX] [Abstract] [Download PDF]
  

  This article is about applications that can be customized or extended through their own user interface. This is achieved by the interface{\’}s ability to interpret users’ non-literal expressions, namely metaphorical and metonymic ones. Such increased interpretive intelligence depends on static and dynamic models of the domain and application, from which new figurative meanings are abducted automatically or semi-automatically. The system performs controlled modifications on the underlying models, based on inferences it draws about users’ intentions as they produce figurative utterances.

  @Article{Barbosa2001ExtendingSoftwareMetaphors,
  abstract = {This article is about applications that can be customized or extended through their own user interface. This is achieved by the interface{\'}s ability to interpret users' non-literal expressions, namely metaphorical and metonymic ones. Such increased interpretive intelligence depends on static and dynamic models of the domain and application, from which new figurative meanings are abducted automatically or semi-automatically. The system performs controlled modifications on the underlying models, based on inferences it draws about users' intentions as they produce figurative utterances.},
  author = {Barbosa, S.D.J. and de Souza, C.S.},
  journal = {Knowledge-Based Systems},
  pages = {15--27},
  title = {Extending Software through Metaphors and Metonymies},
  volume = {14},
  year = {2001},
  doi = {10.1016/S0950-7051(00)00104-0},
  number = {1-2},
  url = {https://www.sciencedirect.com/science/article/pii/S0950705100001040},
  issn = {0950-7051},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• M. S. Silveira, C. S. de Souza, and S. D. J. Barbosa, “Semiotic engineering contributions for designing online help systems,” in Proceedings of the 19th annual international conference on computer documentation, New York, NY, USA, 2001, p. 31–38. doi:10.1145/501516.501523
  [BibTeX] [Abstract]
  

  Our goal is to improve the content of help systems and provide better access to it, by giving users opportunities to signal breakdowns during interaction. To this end, we use a semiotic engineering model that explores both direct and indirect messages sent from designers to users via systems’ interfaces. These messages represent how the designers conceived of the application, how they built it, and why. The online help system is an important component, because this is where designers have the best chances to explicitly express their vision. In this paper we review some of the classifications used to characterize help systems, and suggest that user-intent sensitivity should be explored as a new classification if we are targeting at efficient designer/user communication. We allow users to signal their intents by choosing among a limited set of predefined utterances, which provide an entry point to a cohesive discourse structure. The discourse is about the application{\’}s design rationale, and the operational and tactical instructions about how to use the application. Coupled with the application{\’}s conceptual model, and also the task and interaction models, these utterances allow help systems to provide information with increased probability of addressing the user{\’}s intentions.

  @InProceedings{Silveira2001SemioticEngineeringContributions,
  abstract = {Our goal is to improve the content of help systems and provide better access to it, by giving users opportunities to signal breakdowns during interaction. To this end, we use a semiotic engineering model that explores both direct and indirect messages sent from designers to users via systems' interfaces. These messages represent how the designers conceived of the application, how they built it, and why. The online help system is an important component, because this is where designers have the best chances to explicitly express their vision. In this paper we review some of the classifications used to characterize help systems, and suggest that user-intent sensitivity should be explored as a new classification if we are targeting at efficient designer/user communication. We allow users to signal their intents by choosing among a limited set of predefined utterances, which provide an entry point to a cohesive discourse structure. The discourse is about the application{\'}s design rationale, and the operational and tactical instructions about how to use the application. Coupled with the application{\'}s conceptual model, and also the task and interaction models, these utterances allow help systems to provide information with increased probability of addressing the user{\'}s intentions.},
  address = {New York, NY, USA},
  author = {Silveira, Milene Selbach and de Souza, Clarisse Sieckenius and Barbosa, Simone D. J.},
  booktitle = {Proceedings of the 19th Annual International Conference on Computer Documentation},
  location = {Sante Fe, New Mexico, USA},
  pages = {31--38},
  publisher = {ACM},
  title = {Semiotic Engineering Contributions for Designing Online Help Systems},
  year = {2001},
  series = {SIGDOC '01},
  acmid = {501523},
  doi = {10.1145/501516.501523},
  isbn = {1-58113-295-6},
  keywords = {communicability, online help systems, semiotic engineering},
  numpages = {8},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, “Semiotic approaches to user interface design – editorial,” Knowledge-based systems, vol. 14, iss. 8, p. 415–418, 2001. doi:10.1016/S0950-7051(01)00133-2
  [BibTeX] [Abstract] [Download PDF]
  

  This Special Issue of Knowledge-Based Systems gives the readers interested in representation and communication issues a chance to assess a wide range of perspectives on what Semiotics has in common not only with HCI, but also with Computer Science in general.

  @Article{Souza2001SemioticApproachesUser,
  abstract = {This Special Issue of Knowledge-Based Systems gives the readers interested in representation and communication issues a chance to assess a wide range of perspectives on what Semiotics has in common not only with HCI, but also with Computer Science in general.},
  author = {de Souza, C.S.},
  journal = {Knowledge-Based Systems},
  pages = {415--418},
  title = {Semiotic Approaches to User Interface Design - Editorial},
  volume = {14},
  year = {2001},
  doi = {10.1016/S0950-7051(01)00133-2},
  number = {8},
  url = {https://www.sciencedirect.com/science/article/pii/S0950705101001332},
  issn = {0950-7051},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, S. D. J. Barbosa, and S. R. P. da Silva, “Semiotic engineering principles for evaluating end-user programming environments,” Interacting with computers, vol. 13, iss. 4, p. 467–495, 2001. doi:10.1016/S0953-5438(00)00051-5
  [BibTeX] [Abstract] [Download PDF]
  

  End user programming (EUP) environments are difficult to evaluate empirically. Most users do not engage in programming, and those who do are often discouraged by the complexity of programming tasks. Often the difficulties arise from the programming languages in which users are expected to express themselves. But there are other difficulties associated with designing extensions and adjustments to artifacts that have been originally designed by others. This paper characterizes EUP as a semiotic design process, and presents two principles that can be used to illustrate the distinctions between the various kinds of techniques and approaches proposed in this field. The principles support a preliminary theoretical mode of EUP and should thus facilitate the definition and interpretation of empirical evaluation studies. They also define some specific semiotic qualifications that more usable and applicable EUP languages could be expected to have.

  @Article{Souza2001SemioticEngineeringPrinciples,
  abstract = {End user programming (EUP) environments are difficult to evaluate empirically. Most users do not engage in programming, and those who do are often discouraged by the complexity of programming tasks. Often the difficulties arise from the programming languages in which users are expected to express themselves. But there are other difficulties associated with designing extensions and adjustments to artifacts that have been originally designed by others. This paper characterizes EUP as a semiotic design process, and presents two principles that can be used to illustrate the distinctions between the various kinds of techniques and approaches proposed in this field. The principles support a preliminary theoretical mode of EUP and should thus facilitate the definition and interpretation of empirical evaluation studies. They also define some specific semiotic qualifications that more usable and applicable EUP languages could be expected to have.},
  author = {de Souza, C.S. and Barbosa, S.D.J. and da Silva, S.R.P.},
  journal = {Interacting with Computers},
  pages = {467--495},
  title = {Semiotic Engineering Principles for Evaluating End-User Programming Environments},
  volume = {13},
  year = {2001},
  doi = {10.1016/S0953-5438(00)00051-5},
  number = {4},
  url = {https://academic.oup.com/iwc/article-abstract/13/4/467/733385},
  issn = {0953-5438},
  keywords = {End-user programming,Evaluation methods,Semiotic engineering,Theoretical model,Usability},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, S. D. J. Barbosa, and R. O. Prates, “A semiotic engineering approach to user interface design,” Knowledge-based systems, vol. 14, iss. 8, p. 461–465, 2001. doi:10.1016/S0950-7051(01)00136-8
  [BibTeX] [Abstract] [Download PDF]
  

  Designing software involves good perception, good reasoning, and a talent to express oneself effectively through programming and interactive languages. Semiotic theories can help HCI designers increase their power to perceive, reason and communicate. By presenting some of the results we have reached with semiotic engineering over the last few years, we suggest that the main contributions of semiotic theory in supporting HCI design are: to provide designers with new perceptions on the process and product of HCI design; to bind together all the stages of software development and use, giving them a unique homogeneous treatment; and to pose innovative questions that extend the frontiers of HCI investigations.

  @Article{Souza2001SemioticEngineeringApproach,
  abstract = {Designing software involves good perception, good reasoning, and a talent to express oneself effectively through programming and interactive languages. Semiotic theories can help HCI designers increase their power to perceive, reason and communicate. By presenting some of the results we have reached with semiotic engineering over the last few years, we suggest that the main contributions of semiotic theory in supporting HCI design are: to provide designers with new perceptions on the process and product of HCI design; to bind together all the stages of software development and use, giving them a unique homogeneous treatment; and to pose innovative questions that extend the frontiers of HCI investigations.},
  author = {de Souza, C.S. and Barbosa, S.D.J. and Prates, R.O.},
  journal = {Knowledge-Based Systems},
  pages = {461--465},
  title = {A Semiotic Engineering Approach to User Interface Design},
  volume = {14},
  year = {2001},
  doi = {10.1016/S0950-7051(01)00136-8},
  number = {8},
  url = {https://www.sciencedirect.com/science/article/pii/S0950705101001368},
  issn = {0950-7051},
  keywords = {HCI design,Interdisciplinary studies,Semiotic engineering},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, S. D. J. Barbosa, and R. O. Prates, “A semiotic engineering approach to hci,” in Conference on human factors in computing systems – proceedings, New York, NY, USA, 2001, p. 55–56. doi:10.1145/634067.634104
  [BibTeX] [Abstract]
  

  Designing software involves good perception, good reasoning, and a talent to express oneself effectively through programming and interactive languages. Semiotic theories can help HCI designers increase their power to perceive, reason and communicate. In this paper we present the semiotic engineering approach to HCI and some of the results that have been reached at the Semiotic Engineering Research Group (SERG) at the Informatics Department at the Pontifical Catholic University of Rio de Janeiro (PUC-Rio). Copyright \textcopyright 2012 ACM, Inc.

  @InProceedings{Souza2001SemioticEngineeringApproacha,
  abstract = {Designing software involves good perception, good reasoning, and a talent to express oneself effectively through programming and interactive languages. Semiotic theories can help HCI designers increase their power to perceive, reason and communicate. In this paper we present the semiotic engineering approach to HCI and some of the results that have been reached at the Semiotic Engineering Research Group (SERG) at the Informatics Department at the Pontifical Catholic University of Rio de Janeiro (PUC-Rio). Copyright \textcopyright 2012 ACM, Inc.},
  address = {New York, NY, USA},
  author = {de Souza, C.S. and Barbosa, S.D.J. and Prates, R.O.},
  booktitle = {Conference on Human Factors in Computing Systems - Proceedings},
  location = {Seattle, Washington},
  pages = {55--56},
  publisher = {ACM},
  title = {A Semiotic Engineering Approach to HCI},
  year = {2001},
  series = {CHI EA '01},
  acmid = {634104},
  doi = {10.1145/634067.634104},
  isbn = {1581133405 | 9781581133400},
  keywords = {HCI,Interdisciplinary studies,Semiotic engineering},
  numpages = {2},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

2000

• S. D. J. Barbosa and C. S. de Souza, “Extending software through metaphors and metonymies,” in Proceedings of the 5th international conference on intelligent user interfaces, New York, NY, USA, 2000, p. 13–20. doi:10.1145/325737.325756
  [BibTeX] [Abstract]
  

  This article is about applications that can be customized or extended through their own user interface. This is achieved by the interface{\’}s ability to interpret users’ non-literal expressions, namely metaphorical and metonymic ones. Such increased interpretive intelligence depends on static and dynamic models of the domain and application, from which new figurative meanings are abducted automatically or semi-automatically. The system performs controlled modifications on the underlying models, based on its interferences about users’ intentions as they produce figurative utterances.

  @InProceedings{Barbosa2000ExtendingSoftwareMetaphors,
  abstract = {This article is about applications that can be customized or extended through their own user interface. This is achieved by the interface{\'}s ability to interpret users' non-literal expressions, namely metaphorical and metonymic ones. Such increased interpretive intelligence depends on static and dynamic models of the domain and application, from which new figurative meanings are abducted automatically or semi-automatically. The system performs controlled modifications on the underlying models, based on its interferences about users' intentions as they produce figurative utterances.},
  address = {New York, NY, USA},
  author = {Barbosa, Simone D. J. and de Souza, Clarisse Sieckenius},
  booktitle = {Proceedings of the 5th International Conference on Intelligent User Interfaces},
  location = {New Orleans, Louisiana, USA},
  pages = {13--20},
  publisher = {ACM},
  title = {Extending Software through Metaphors and Metonymies},
  year = {2000},
  series = {IUI '00},
  acmid = {325756},
  doi = {10.1145/325737.325756},
  isbn = {1-58113-134-8},
  keywords = {abductive reasoning, end-user programming, interfaces for knowledge-based systems, metaphor, metonymy},
  numpages = {8},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• R. O. Prates, S. D. J. Barbosa, and C. S. de Souza, “A case study for evaluating interface design through communicability,” in Proceedings of the 3rd conference on designing interactive systems: processes, practices, methods, and techniques, New York, NY, USA, 2000, p. 308–316. doi:10.1145/347642.347777
  [BibTeX] [Abstract]
  

  Communicability evaluation is a method based on semiotic engineering that aims at assessing how designers communicate to users their design intents and chosen interactive principles, and thus complements traditional usability evaluation methods.In this paper, we present a case study in which we evaluate how communicablity tagging of an application changes along users learning curves. Our main goal was to have indications of how communicability evaluation along a learning period helps provide valuable information about interface designs, and identify communicative and interactive problems, as users become more proficient in the application.

  @InProceedings{Prates2000CaseStudyEvaluating,
  abstract = {Communicability evaluation is a method based on semiotic engineering that aims at assessing how designers communicate to users their design intents and chosen interactive principles, and thus complements traditional usability evaluation methods.In this paper, we present a case study in which we evaluate how communicablity tagging of an application changes along users learning curves. Our main goal was to have indications of how communicability evaluation along a learning period helps provide valuable information about interface designs, and identify communicative and interactive problems, as users become more proficient in the application.},
  address = {New York, NY, USA},
  author = {Prates, Raquel O. and Barbosa, Simone D. J. and de Souza, Clarisse S.},
  booktitle = {Proceedings of the 3rd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques},
  location = {New York City, New York, USA},
  pages = {308--316},
  publisher = {ACM},
  title = {A Case Study for Evaluating Interface Design through Communicability},
  year = {2000},
  series = {DIS '00},
  acmid = {347777},
  doi = {10.1145/347642.347777},
  isbn = {1-58113-219-0},
  keywords = {communicability, interface design evaluation, semiotic engineering, users' learning curves},
  numpages = {9},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• R. O. Prates, C. S. de Souza, and S. D. J. Barbosa, “Methods and tools: a method for evaluating the communicability of user interfaces,” Interactions, vol. 7, iss. 1, p. 31–38, 2000. doi:10.1145/328595.328608
  [BibTeX] [Abstract]
  

  The communicability evaluation method described in this paper provides a way for the evaluators to identify points in which the designer may have failed to convey to users his intended message, as well as a way for users to communicate with the actual designers, although indirectly, what they have not understood or agreed with. When users perform the communicability evaluation, they can spontaneously express their expectations, attitudes, interpretations, approval, or rejection toward HCI design choices present in software. When designers or experts perform the test, they produce what should be perceived as an inferred message about the same topics, qualified by the evaluator{\’}s background and expertise in HCI.

  @Article{Prates2000MethodsToolsMethod,
  abstract = {The communicability evaluation method described in this paper provides a way for the evaluators to identify points in which the designer may have failed to convey to users his intended message, as well as a way for users to communicate with the actual designers, although indirectly, what they have not understood or agreed with. When users perform the communicability evaluation, they can spontaneously express their expectations, attitudes, interpretations, approval, or rejection toward HCI design choices present in software. When designers or experts perform the test, they produce what should be perceived as an inferred message about the same topics, qualified by the evaluator{\'}s background and expertise in HCI.},
  author = {Prates, Raquel O. and de Souza, Clarisse S. and Barbosa, Simone D. J.},
  journal = {interactions},
  pages = {31--38},
  title = {Methods and Tools: A Method for Evaluating the Communicability of User Interfaces},
  volume = {7},
  year = {2000},
  doi = {10.1145/328595.328608},
  month = jan,
  number = {1},
  acmid = {328608},
  address = {New York, NY, USA},
  issn = {1072-5520},
  issue_date = {Jan.-Feb. 2000},
  numpages = {8},
  owner = {SERG},
  publisher = {ACM},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, “Hci in brazil,” Sigchi bulletin, vol. 32, iss. 2, p. 15–19, 2000. doi:10.1145/360405.360425
  [BibTeX] [Abstract]
  

  In less than 3 years, two national HCI workshops have been held gathering HCI researchers, practitioners, and students from different states in the country. This is the result of a combination of factors whose origins can be traced to the needs and trends in our local computer industry, to the pace of technological changes in Brazilian society, to an agile response of those involved in science, technology and education policies, to changes in the curricula of college and university programs, to the pressing challenges of a global economy and culture, and to many other factors we cannot competently survey here.

  @Article{Souza2000HCIBrazil,
  abstract = {In less than 3 years, two national HCI workshops have been held gathering HCI researchers, practitioners, and students from different states in the country. This is the result of a combination of factors whose origins can be traced to the needs and trends in our local computer industry, to the pace of technological changes in Brazilian society, to an agile response of those involved in science, technology and education policies, to changes in the curricula of college and university programs, to the pressing challenges of a global economy and culture, and to many other factors we cannot competently survey here.},
  author = {Clarisse Sieckenius de Souza},
  journal = {SIGCHI Bulletin},
  pages = {15--19},
  title = {HCI in Brazil},
  volume = {32},
  year = {2000},
  doi = {10.1145/360405.360425},
  month = apr,
  number = {2},
  acmid = {360425},
  address = {New York, NY, USA},
  issn = {0736-6906},
  issue_date = {April 2000},
  numpages = {5},
  owner = {SERG},
  publisher = {ACM},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, R. O. Prates, S. D. J. Barbosa, and E. A. Edmonds, “Semiotic approaches to user interface design,” in Conference on human factors in computing systems – proceedings, New York, NY, USA, 2000, p. 366. doi:10.1145/633292.633513
  [BibTeX] [Abstract]
  

  Hartson (1998) has pointed out that although people have studied interfaces and applied theories (mostly cognitive psychology) to them, and that the majority of the guidelines and principles applied have arisen mostly out of practice than theory. He claims that the HCI field, especially in realworld practice, could benefit a great deal more from theory. As the discipline whose aim is to investigate processes of communication and signification amongst agents in general, Semiotics is bound to contribute to the field of humancomputer interaction with complementary perspectives, new methods and concepts, which can shed light on some of the major HCI challenges in design and evaluation. Viewing HCI as a complex human communication process, involving designers and users, and the mediation of communicative artifacts, Computer Semiotics and Semiotic Engineering, for instance, are some of the approaches in Applied Semiotics that directly address the issues bearing on human-computer interaction. The workshop aims to bring together researchers and practitioners of HCI and Semiotics and to give them the opportunity to discuss how the two fields can provide new knowledge and a new interdisciplinary research agenda in HCI.

  @InProceedings{Souza2000SemioticApproachesUser,
  abstract = {Hartson (1998) has pointed out that although people have studied interfaces and applied theories (mostly cognitive psychology) to them, and that the majority of the guidelines and principles applied have arisen mostly out of practice than theory. He claims that the HCI field, especially in realworld practice, could benefit a great deal more from theory. As the discipline whose aim is to investigate processes of communication and signification amongst agents in general, Semiotics is bound to contribute to the field of humancomputer interaction with complementary perspectives, new methods and concepts, which can shed light on some of the major HCI challenges in design and evaluation. Viewing HCI as a complex human communication process, involving designers and users, and the mediation of communicative artifacts, Computer Semiotics and Semiotic Engineering, for instance, are some of the approaches in Applied Semiotics that directly address the issues bearing on human-computer interaction. The workshop aims to bring together researchers and practitioners of HCI and Semiotics and to give them the opportunity to discuss how the two fields can provide new knowledge and a new interdisciplinary research agenda in HCI.},
  address = {New York, NY, USA},
  author = {de Souza, C.S. and Prates, R.O. and Barbosa, S.D.J. and Edmonds, E.A.},
  booktitle = {Conference on Human Factors in Computing Systems - Proceedings},
  location = {The Hague, The Netherlands},
  pages = {366},
  publisher = {ACM},
  title = {Semiotic Approaches to User Interface Design},
  year = {2000},
  series = {CHI EA '00},
  acmid = {633513},
  doi = {10.1145/633292.633513},
  isbn = {1581132484 | 9781581132489},
  keywords = {Communicative artifacts,Computer semiotics,Computer-mediated human interaction,Semiotic engineering},
  numpages = {1},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• C. S. de Souza, R. O. Prates, and T. Carey, “Missing and declining affordances: are these appropriate concepts?,” Journal of the brazilian computer society, vol. 7, iss. 1, p. 26–34, 2000. doi:10.1590/S0104-65002000000200004
  [BibTeX] [Abstract] [Download PDF]
  

  The concept of affordance has been brought to HCI by Don Norman, who has recently protested against its misuse by designers. They say they will put affordances in the interface, or afford this or that to the users, but Norman points out that affordances only exist inasmuch as they are perceived by users. Therefore, it doesn’t make sense to use the term as designers do. This paper takes the designers’ phrases as a spontaneous expression of design intent and explores the correspondences between these and two of the phenomena captured by communicability evaluation: missing and declining affordances. It highlights some useful distinctions between levels of affordances, and hints at possible links between communicative and cognitive perspectives. It suggests that framing affordances within a broader communicative dimension, and taking advantage of the rhetoric that people use to describe what they are doing, can bring interesting insights to design.

  @Article{Souza2000MissingDecliningAffordances,
  abstract = {The concept of affordance has been brought to HCI by Don Norman, who has recently protested against its misuse by designers. They say they will put affordances in the interface, or afford this or that to the users, but Norman points out that affordances only exist inasmuch as they are perceived by users. Therefore, it doesn't make sense to use the term as designers do. This paper takes the designers' phrases as a spontaneous expression of design intent and explores the correspondences between these and two of the phenomena captured by communicability evaluation: missing and declining affordances. It highlights some useful distinctions between levels of affordances, and hints at possible links between communicative and cognitive perspectives. It suggests that framing affordances within a broader communicative dimension, and taking advantage of the rhetoric that people use to describe what they are doing, can bring interesting insights to design.},
  author = {de Souza, C.S. and Prates, R.O. and Carey, T.},
  journal = {Journal of the Brazilian Computer Society},
  pages = {26--34},
  title = {Missing and Declining Affordances: Are These Appropriate Concepts?},
  volume = {7},
  year = {2000},
  doi = {10.1590/S0104-65002000000200004},
  number = {1},
  url = {http://ref.scielo.org/d8y99f},
  issn = {01046500 01046500},
  keywords = {Affordances,Communicability evaluation,Semiotic engineering},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• P. Vilain, D. Schwabe, and C. S. de Souza, “A diagrammatic tool for representing user interaction in uml,” in Uml 2000 — the unified modeling language: advancing the standard third international conference york, uk, october 2–6, 2000 proceedings, Berlin, Heidelberg, 2000, p. 133–147. doi:10.1007/3-540-40011-7_10
  [BibTeX] [Abstract]
  

  The UML suggests the employment of use cases for capturing the requirements and for specifying the interaction between the users and the system being modeled. Use cases are easily understood by users since they are essentially textual descriptions, but lack the precision and the conciseness accomplished by the other diagrammatic tools of UML. Besides, there is no systematic method that helps the designer to obtain such UML diagrams from a set of use cases. In this paper we present a diagrammatic tool to represent the users/system interaction called User Interaction Diagram (UID). UIDs have proven to be a valuable tool to gather requirements since they describe the ex-change of information between the system and the user in a high level of abstraction, without considering specific user interface aspects and design details as in other UML diagrams. We show how UIDs can be incorporated into the requirements and analysis workflows of the Unified Process for software development.

  @InProceedings{Vilain2000DiagrammaticToolRepresenting,
  abstract = {The UML suggests the employment of use cases for capturing the requirements and for specifying the interaction between the users and the system being modeled. Use cases are easily understood by users since they are essentially textual descriptions, but lack the precision and the conciseness accomplished by the other diagrammatic tools of UML. Besides, there is no systematic method that helps the designer to obtain such UML diagrams from a set of use cases. In this paper we present a diagrammatic tool to represent the users/system interaction called User Interaction Diagram (UID). UIDs have proven to be a valuable tool to gather requirements since they describe the ex-change of information between the system and the user in a high level of abstraction, without considering specific user interface aspects and design details as in other UML diagrams. We show how UIDs can be incorporated into the requirements and analysis workflows of the Unified Process for software development.},
  address = {Berlin, Heidelberg},
  author = {Vilain, Patrícia and Schwabe, Daniel and de Souza, Clarisse Sieckenius},
  booktitle = {UML 2000 — The Unified Modeling Language: Advancing the Standard Third International Conference York, UK, October 2–6, 2000 Proceedings},
  editor = {Evans, Andy and Kent, Stuart and Selic, Bran},
  pages = {133--147},
  publisher = {Springer Berlin Heidelberg},
  title = {A Diagrammatic Tool for Representing User Interaction in UML},
  year = {2000},
  doi = {10.1007/3-540-40011-7_10},
  isbn = {978-3-540-40011-0},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• S. Barbosa, S. R. da Silva, and C. de Souza, “Extensible software applications as semiotic engineering laboratories,” in Semiotics and information sciences, M. Danesi, P. Perron, J. Umiker-Sebeok, and A. Watanabe, Eds., Toronto, Canada: Legas press, 2000, p. 77–96.
  [BibTeX] [Abstract]
  

  Semiotic aspects of programs, programming and computing have been explored by researchers and philosophers who have adopted a wide spectrum of perspectives. In particular, the investigation of engineering tasks involved in designing and implementing user interfaces, previously explored within the framework of cognitive engineering and ontological engineering, has led to independent versions of what a semiotic engineering endeavor might be. Stressing either on the overall semiotic environments within which users and systems are immersed or on a semiotic characterization of specific artificial language design, interpretation and use, recent studies in semiotic engineering attempt to capture the technological meaning of Umberto Eco’s fictional semiotic machines. In this paper, we try to make one more step in the direction of understanding the semiotic challenges of user interface design in the context of extensible applications. While in previous work, we focussed on proposing and/or discussing mechanisms and constraints that support the possibility of letting users (re)program and adapt computer applications to satisfy their personal needs, we now try to identify and formulate some specific semiotic issues associated to end user programming (EUP).

  @InCollection{Barbosa2000ExtensibleSoftwareApplicationsa,
  abstract = {Semiotic aspects of programs, programming and computing have been explored by researchers and philosophers who have adopted a wide spectrum of perspectives. In particular, the investigation of engineering tasks involved in designing and implementing user interfaces, previously explored within the framework of cognitive engineering and ontological engineering, has led to independent versions of what a semiotic engineering endeavor might be. Stressing either on the overall semiotic environments within which users and systems are immersed or on a semiotic characterization of specific artificial language design, interpretation and use, recent studies in semiotic engineering attempt to capture the technological meaning of Umberto Eco's fictional semiotic machines. In this paper, we try to make one more step in the direction of understanding the semiotic challenges of user interface design in the context of extensible applications. While in previous work, we focussed on proposing and/or discussing mechanisms and constraints that support the possibility of letting users (re)program and adapt computer applications to satisfy their personal needs, we now try to identify and formulate some specific semiotic issues associated to end user programming (EUP).},
  address = {Toronto, Canada},
  author = {Barbosa, Simone and da Silva, Sergio Roberto and de Souza, Clarisse},
  booktitle = {Semiotics and Information Sciences},
  editor = {Marcel Danesi and Paul Perron and Jean Umiker-Sebeok and Anthony Watanabe},
  pages = {77--96},
  publisher = {Legas Press},
  title = {Extensible Software Applications as Semiotic Engineering Laboratories},
  year = {2000},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

1999

• D. A. S. Oliveira, C. S. de Souza, and E. H. Haeusler, “Structured argument generation in a logic-based kb system,” in Logic, language and computation (vol. 2), L. S. Moss, J. Ginzburg, and M. de Rijke, Eds., Stanford, California: Center for the study of language and information (csli), stanford university, 1999, p. 167–190.
  [BibTeX] [Abstract] [Download PDF]
  

  This paper presents a method for the transformation of Natural Deduction proofs into hypertext-like structured explanations to be provided by knowledge-based systems. First-Order Logic and a variant of the Natural Deduction system are taken as a basis for representing knowledge and reasoning over a generic classification domain. Information selection and restructuring are used to convert proofs into argumentation schemata. Our goal is to produce structured arguments that can be converted into Natural Language explanatory hypertexts which satisfy some pragmatical constraints. Thus, pragmatically motivated rules are incorporated to the semantic component of a friendly user interface language in which explanations are requested and conveyed.

  @InBook{Oliveira1999StructuredArgumentGeneration,
  address = {Stanford, California},
  author = {Denise Aboim Sande Oliveira and Clarisse Sieckenius de Souza and Edward Hermann Haeusler},
  booktitle = {Logic, Language and Computation (Vol. 2)},
  editor = {Lawrence S. Moss and Jonathan Ginzburg and Maarten {de Rijke}},
  pages = {167--190},
  publisher = {Center for the Study of Language and Information (CSLI), Stanford University},
  title = {Structured Argument Generation in a Logic-Based KB System},
  year = {1999},
  abstract = {This paper presents a method for the transformation of Natural Deduction proofs into hypertext-like structured explanations to be provided by knowledge-based systems. First-Order Logic and a variant of the Natural Deduction system are taken as a basis for representing knowledge and reasoning over a generic classification domain. Information selection and restructuring are used to convert proofs into argumentation schemata. Our goal is to produce structured arguments that can be converted into Natural Language explanatory hypertexts which satisfy some pragmatical constraints. Thus, pragmatically motivated rules are incorporated to the semantic component of a friendly user interface language in which explanations are requested and conveyed.},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {https://web.stanford.edu/group/cslipublications/cslipublications/site/1575861801.shtml#},
  }

1998

• R. O. Prates and C. S. de Souza, “On the rationale of interface semiotics for multi-user applications,” in Proceedings of the 1998 ieee international symposium on intelligent control (isic) held jointly with ieee international symposium on computational intelligence in robotics and automation (cira) intell, 1998, p. 759–764. doi:10.1109/ISIC.1998.713815
  [BibTeX] [Abstract] [Download PDF]
  

  The design of multi-user interfaces poses additional problems in terms of communicative systems, since not only must users interact with software, but also among themselves. This paper presents a semiotically motivated proposal for an interactive language design model that supports explanations about design rationale and augments the “teachability” of computer supported collaborative work applications.

  @InProceedings{Prates1998RationaleInterfaceSemiotics,
  abstract = {The design of multi-user interfaces poses additional problems in terms of communicative systems, since not only must users interact with software, but also among themselves. This paper presents a semiotically motivated proposal for an interactive language design model that supports explanations about design rationale and augments the "teachability" of computer supported collaborative work applications.},
  author = {R. O. Prates and C. S. de Souza},
  booktitle = {Proceedings of the 1998 IEEE International Symposium on Intelligent Control (ISIC) held jointly with IEEE International Symposium on Computational Intelligence in Robotics and Automation (CIRA) Intell},
  pages = {759--764},
  title = {On the Rationale of Interface Semiotics for Multi-user Applications},
  year = {1998},
  month = sep,
  doi = {10.1109/ISIC.1998.713815},
  issn = {2158-9860},
  keywords = {user interface management systems;interactive systems;groupware;knowledge based systems;grammars;interface semiotics;multiple user interfaces;interactive language;design rationale;computer supported collaborative work;groupware;human computer interface;knowledge based system;interface grammar;Collaborative work;Collaborative software;Libraries;Proposals;Guidelines;Software design;Protocols;Design engineering;Human computer interaction;Computer industry},
  owner = {SERG},
  timestamp = {2020-10-21},
  url = {https://ieeexplore.ieee.org/abstract/document/713815},
  }

• F. Varejão, M. Fromherz, A. Garcia, and C. de Souza, “Integrated framework for the specification and design of reprographic machines,” in Applications of artificial intelligence in engineering, 1998, p. 63–66.
  [BibTeX] [Abstract]
  

  Developing modern reprographic machines is a non-trivial task, due to ever-increasing functionality and productivity requirements. Competition in the market place motivates additional requirements, such as low cost and reduced size, and an important part of the design is often to optimize conflicting objectives. Time-to-market requirements make the design task even harder by imposing strong limitations on the development time schedule.

  @InProceedings{Varejao1998IntegratedFrameworkSpecification,
  abstract = {Developing modern reprographic machines is a non-trivial task, due to ever-increasing functionality and productivity requirements. Competition in the market place motivates additional requirements, such as low cost and reduced size, and an important part of the design is often to optimize conflicting objectives. Time-to-market requirements make the design task even harder by imposing strong limitations on the development time schedule.},
  author = {Varejão, F. and Fromherz, M. and Garcia, A. and de Souza, C.},
  booktitle = {Applications of Artificial Intelligence in Engineering},
  pages = {63--66},
  title = {Integrated Framework for the Specification and Design of Reprographic Machines},
  year = {1998},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

1997

• A. C. B. Garcia and C. S. de Souza, “Add + : including rhetorical structures in active documents,” Artificial intelligence for engineering design, analysis and manufacturing: aiedam, vol. 11, iss. 2, p. 109–124, 1997. doi:10.1017/S0890060400001906
  [BibTeX] [Abstract]
  

  A design is a plan containing guidelines to build and understand an artifact. Generally, this plan is constructed by a team of designers with different tasks, but sharing a common objective, that is, to create a high-quality, low-cost integrated artifact. Active Design Documents (ADDs) are powerful tools for cooperative design because they account for revealing the rationale among design participants while assisting each of them in their own. Design rationale capture and retrieval are critical issues on building documentation assistant tools. In this paper, we propose to achieve more efficient and effective delivery of design and designers intent by resorting to rhetorical means. The wealth of knowledge kept in ADD{\’}s knowledge bases is organized into high-level Rhetorical Structure Theory (RST) schema and mapped onto input and output screen configurations that gear the interaction between systems and users. We illustrate the effects of such an organization with evidences from an implemented version of ADD for the domain of offshore platform.

  @Article{Garcia1997Add,
  abstract = {A design is a plan containing guidelines to build and understand an artifact. Generally, this plan is constructed by a team of designers with different tasks, but sharing a common objective, that is, to create a high-quality, low-cost integrated artifact. Active Design Documents (ADDs) are powerful tools for cooperative design because they account for revealing the rationale among design participants while assisting each of them in their own. Design rationale capture and retrieval are critical issues on building documentation assistant tools. In this paper, we propose to achieve more efficient and effective delivery of design and designers intent by resorting to rhetorical means. The wealth of knowledge kept in ADD{\'}s knowledge bases is organized into high-level Rhetorical Structure Theory (RST) schema and mapped onto input and output screen configurations that gear the interaction between systems and users. We illustrate the effects of such an organization with evidences from an implemented version of ADD for the domain of offshore platform.},
  author = {Garcia, A.C.B. and de Souza, C.S.},
  journal = {Artificial Intelligence for Engineering Design, Analysis and Manufacturing: AIEDAM},
  pages = {109--124},
  title = {Add + : Including Rhetorical Structures in Active Documents},
  volume = {11},
  year = {1997},
  doi = {10.1017/S0890060400001906},
  number = {2},
  issn = {0890-0604},
  keywords = {Active Documents,Design Rationale,Natural Language Explanations,RST,Rhetorical Structuring},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

• R. O. Prates, C. S. Sieckenius de Souza, and A. C. B. Garcia, “A semiotic framework for multi-user interfaces,” Sigchi bulletin, vol. 29, iss. 2, p. 28–39, 1997. doi:10.1145/255065.255070
  [BibTeX]

  @Article{Prates1997SemioticFrameworkMulti,
  author = {Prates, Raquel Oliveira and Sieckenius de Souza, Clarisse Sieckenius and Garcia, Ana Cristina Bicharra},
  journal = {SIGCHI Bulletin},
  pages = {28--39},
  title = {A Semiotic Framework for Multi-user Interfaces},
  volume = {29},
  year = {1997},
  doi = {10.1145/255065.255070},
  month = apr,
  number = {2},
  acmid = {255070},
  address = {New York, NY, USA},
  issn = {0736-6906},
  issue_date = {April 1997},
  numpages = {12},
  owner = {SERG},
  publisher = {ACM},
  timestamp = {2020-10-21},
  }

1996

• P. G. de Azevedo, S. C. de Souza, and B. Feijo, “Enhancing the human-computer interface of power system applications,” Ieee transactions on power systems, vol. 11, iss. 2, p. 646–653, 1996. doi:10.1109/59.496134
  [BibTeX] [Abstract] [Download PDF]
  

  This paper examines a topic of increasing importance: the interpretation of the massive amount of data available to power system engineers. The solutions currently adopted in the presentation of data in graphical interfaces are discussed. It is demonstrated that the representations of electric diagrams can be considerably enhanced through the adequate exploitation of resources available in full-graphics screens and the use of basic concepts from human-factors research. Enhanced representations of electric diagrams are proposed and tested. The objective is to let the user “see” the behavior of the power system, allowing for better interpretation of program data and results and improving user’s productivity.

  @Article{Azevedo1996EnhancingHumanComputer,
  abstract = {This paper examines a topic of increasing importance: the interpretation of the massive amount of data available to power system engineers. The solutions currently adopted in the presentation of data in graphical interfaces are discussed. It is demonstrated that the representations of electric diagrams can be considerably enhanced through the adequate exploitation of resources available in full-graphics screens and the use of basic concepts from human-factors research. Enhanced representations of electric diagrams are proposed and tested. The objective is to let the user "see" the behavior of the power system, allowing for better interpretation of program data and results and improving user's productivity.},
  author = {G. Pires de Azevedo and C. Sieckenius de Souza and B. Feijo},
  journal = {IEEE Transactions on Power Systems},
  pages = {646--653},
  title = {Enhancing the Human-Computer Interface of Power System Applications},
  volume = {11},
  year = {1996},
  doi = {10.1109/59.496134},
  month = may,
  number = {2},
  url = {https://ieeexplore.ieee.org/abstract/document/496134},
  issn = {0885-8950},
  keywords = {power system control;graphical user interfaces;human factors;man-machine systems;engineering graphics;power systems;human-computer interface;graphical interfaces;control data presentation;electric diagrams;full-graphics screens;data interpretation;Power systems;Data engineering;Power engineering and energy;Systems engineering and theory;Testing;Productivity},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

1995

• A. C. Bicharra Garcia and C. S. de Souza, “Rhetorical structures in the delivery of design intent,” in Computing in civil engineering (new york), 1995, p. 1443–1452.
  [BibTeX] [Abstract]
  

  Active Documents are powerful tools for capturing design intent. However, delivering design rationale is a challenging task. Current implementations of Active Documents are deprived of global rhetorical organization. Thus, users are prone to misinterpreting the relations that hold among pieces of knowledge on the screen, and to sub estimating the system{\’}s actual potential. In this paper we show how the addition of rhetorically organized explanation plans positively impact the delivery of design intent.

  @InProceedings{BicharraGarcia1995RhetoricalStructuresDelivery,
  abstract = {Active Documents are powerful tools for capturing design intent. However, delivering design rationale is a challenging task. Current implementations of Active Documents are deprived of global rhetorical organization. Thus, users are prone to misinterpreting the relations that hold among pieces of knowledge on the screen, and to sub estimating the system{\'}s actual potential. In this paper we show how the addition of rhetorically organized explanation plans positively impact the delivery of design intent.},
  author = {Bicharra Garcia, Ana Cristina and de Souza, Clarisse Sieckenius},
  booktitle = {Computing in Civil Engineering (New York)},
  pages = {1443--1452},
  title = {Rhetorical Structures in the Delivery of Design Intent},
  year = {1995},
  volume = {2},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

1993

• C. S. de Souza, “The semiotic engineering of user interface languages,” International journal of man-machine studies, vol. 39, iss. 5, p. 753–773, 1993. doi:10.1006/imms.1993.1082
  [BibTeX] [Abstract] [Download PDF]
  

  Semiotic approaches to design have recently shown that systems are messages sent from designers so users. In this paper we examine the nature of such messages and show that systems are messages that can send and receive other messages—they are metacommunication artefacts that should be engineered according to explicit semiotic principles. User interface languages are the primary expressive resource for such complex communication environments. Existing cognitively-based research has provided results which set the target interface designers should hit, but little is said about how to make successful decisions during the process of design itself. In an attempt to give theoretical support to the elaboration of user interface languages, we explore Eco’s Theory of Sign Production (U. Eco, A Theory of Semiotics, Bloomington, IN: Indiana University Press, 1976) and build a semiotic framework within which many design issues can be explained and predicted.

  @Article{Souza1993SemioticEngineeringUser,
  abstract = {Semiotic approaches to design have recently shown that systems are messages sent from designers so users. In this paper we examine the nature of such messages and show that systems are messages that can send and receive other messages—they are metacommunication artefacts that should be engineered according to explicit semiotic principles. User interface languages are the primary expressive resource for such complex communication environments. Existing cognitively-based research has provided results which set the target interface designers should hit, but little is said about how to make successful decisions during the process of design itself. In an attempt to give theoretical support to the elaboration of user interface languages, we explore Eco's Theory of Sign Production (U. Eco, A Theory of Semiotics, Bloomington, IN: Indiana University Press, 1976) and build a semiotic framework within which many design issues can be explained and predicted.},
  author = {Clarisse Sieckenius de Souza},
  journal = {International Journal of Man-Machine Studies},
  pages = {753--773},
  title = {The Semiotic Engineering of User Interface Languages},
  volume = {39},
  year = {1993},
  doi = {10.1006/imms.1993.1082},
  number = {5},
  url = {http://www.sciencedirect.com/science/article/pii/S0020737383710825},
  issn = {0020-7373},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

1992

• C. S. de Souza and M. G. V. das Nunes, “Explanatory text planning in logic based systems,” in Proceedings of the 14th conference on computational linguistics – volume 2, Stroudsburg, PA, USA, 1992, p. 742–748. doi:10.3115/992133.992184
  [BibTeX] [Abstract]
  

  This paper discusses aspects of the planning of explanatory texts for logic based systems. It presents a method for deriving Natural Language text plans from Natural Deduction-based structures. This approach allows for the planning of explanatory texts in a general-purpose logic based system framework, ensuring a greater degree of portability across domains.

  @InProceedings{Souza1992ExplanatoryTextPlanning,
  abstract = {This paper discusses aspects of the planning of explanatory texts for logic based systems. It presents a method for deriving Natural Language text plans from Natural Deduction-based structures. This approach allows for the planning of explanatory texts in a general-purpose logic based system framework, ensuring a greater degree of portability across domains.},
  address = {Stroudsburg, PA, USA},
  author = {de Souza, Clarisse Sieckenius and Nunes, Maria das Graças Volpe},
  booktitle = {Proceedings of the 14th Conference on Computational Linguistics - Volume 2},
  location = {Nantes, France},
  pages = {742--748},
  publisher = {Association for Computational Linguistics},
  title = {Explanatory Text Planning in Logic Based Systems},
  year = {1992},
  series = {COLING '92},
  acmid = {992184},
  doi = {10.3115/992133.992184},
  numpages = {7},
  owner = {SERG},
  timestamp = {2020-10-21},
  }

1990

• D. R. Scott and C. Sieckenius de Souza, “Getting the message across in rst-based text generation,” in Current research in natural language generation, USA: Academic press professional, inc., 1990, p. 47–73.
  [BibTeX] [Abstract]
  

  This chapter examines the problem of generating texts that achieve their communicative goals in an effective way. We discuss an approach to producing effective text that is geared towards ensuring that the rhetorical aspects of a message are not only preserved but enhanced in the text. This approach is strongly influenced by research in psycholinguistics and the psychology of memory, and ís based on a view of stylistics as a matter having rather more to do with cognition than aesthetics.

  @InBook{Scott1990GettingMessageRST,
  address = {USA},
  author = {Scott, Donia R. and Sieckenius de Souza, Clarisse},
  booktitle = {Current Research in Natural Language Generation},
  pages = {47--73},
  publisher = {Academic Press Professional, Inc.},
  title = {Getting the Message across in RST-Based Text Generation},
  year = {1990},
  abstract = {This chapter examines the problem of generating texts that achieve their communicative goals in an effective way. We discuss an approach to producing effective text that is geared towards ensuring that the rhetorical aspects of a message are not only preserved but enhanced in the text. This approach is strongly influenced by research in psycholinguistics and the psychology of memory, and ís based on a view of stylistics as a matter having rather more to do with cognition than aesthetics.},
  isbn = {0122007352},
  numpages = {27},
  owner = {SERG},
  timestamp = {2020-10-21},
  }