HyperNews Home
Using HyperNews (Instructions)

Visual Languages References

Books

Journals

Proceedings

Upcoming Conferences

FTP-able information

(These references should be many other places.)

Miscellaneous WWW pages

(These references should be many other places.)
OOPSLA '93 Visual Object-Oriented Programming Workshop, report by M Burnett
Visual Programming Bibliography
by Dr. Bertrand Ibrahim (bertrand@cui.unige.ch)
Visual Programming and Software Engineering group
ref: Dr. Bertrand Ibrahim (bertrand@cui.unige.ch)

Also see the Computer Based Learning - Software Engineering Group

Garnet
ref: Brad A. Myers, bam+@cs.cmu.edu
Software visualization and animation system at Univ. of Exeter
ref: Lindsey Ford
PROGRES
Self - language and environment
Index of HCI-related material in the Web
ref: Hans de Graaff J.J.deGraaff@TWI.TUDelft.NL
Bibliograph on multimedia and multimodal parsing.
Workgroup on Graphical Programming and Intelligent User Interfaces
Object Orientation and Visual Programming
by Nikos Drakos
Constructing Object-Oriented Software in Interactive Graphical Programming Environments:An Anthology
by Nikos Drakos
Cognitive Theories of Pictorial Representation
Programming in Three Dimensions
thesis by Marc Najork

Graduate programs that include visual programming

Here are some grad programs doing research in visual languages (tell me about more [ send a blurb about profs, languages, courses at your favorite grad school to me so I can include it here!!! ]):

George Mason University:
GRADUATE PROGRAMS AT GMU: Degree programs available include the M.A. or M.F.A. in Visual Information Technology in the College of Arts & Sciences (centering on computer imaging and animation in electronic and digital media technology), the M.Ed. and Ph.D. in Instructional Technology (Graduate School of Education), or the M.S. and Ph.D. in computer science or computational statistics (School of Information Technology & Engineering).
        CONTACT POINT:
                Dr. Chris Dede
                Graduate School of Education
                George Mason University
                4400 University Drive
                Fairfax, VA 22030-4444
                cdede@gmu.edu

        ASSISTANTSHIPS:
                Research Assistantship for Virtual Reality

Waikato University, New Zealand
We are currently conducting research into software development environments which support integrated visual and textual programming (i.e. being able to specify a program using both techniques with full bi-directional consistency management). Included in this is support for collaborative visual (& textual) programming, version control and configuration management for visual (& textual) programs, and flexible user interface specification and generation. We are building both an environment which supports these facilities and an environment generator/OO framework for more easily constructing such systems. This work is a follow on to our earlier SPE/MViews research.
        CONTACT POINT:

                Dr John Grundy
                Department of Computer Science
                University of Waikato
                Private Bag 3105
                Hamilton
                New Zealand
                jgrundy@waikato.ac.nz

Auckland University, New Zealand
        CONTACT POINT:
                Dr John Hosking
                Department of Computer Science
                University of Auckland
                Private Bag
                Auckland
                New Zealand
                j.hosking@cs.aukuni.ac.nz
Massey University, New Zealand
I'm currently running a small research program at Massey University, in New Zealand (that's in the South Pacific) investigating the implications of applying hypertechniques to visual programming languages. The vehicle for this research is a language called HyperPascal, implemented in Prolog with extensions to support object-orientation, and mutual real-time updating of multiple-window systems. Contact me (p.lyons@massey.ac.nz) for more information about possible projects at Masterate, Doctoral or Post-doctoral levels.
        CONTACT POINT:
                Dr. Paul Lyons
                Computer Science Department
                Massey University
                Private Bag 11-222
                Palmerston North
                New Zealand
                p.lyons@massey.ac.nz
Oregon State University
        CONTACT POINT:
                Dr. Margaret Burnett
                burnett@cs.orst.edu
University of Washington
        CONTACT POINT:
                Dr. Steven Tanimoto
                Dr. Alan Borning
University of Kansas
        CONTACT POINT:
                Dr. Allen Ambler
University of Pittsburgh
        CONTACT POINT:
                Dr. S.-K. Chang
Rensselaer Polytechnic Institute
        CONTACT POINT:
                Dr. Ephraim P. Glinert
                glinert@cs.rpi.edu
University of Colorado
        CONTACT POINT:
                Dr. Wayne Citrin
                citrin@cs.colorado.edu
New Mexico State University
        CONTACT POINT:
                Dr. Joseph Pfeiffer
                pfeiffer@nmsu.edu
MIT Visible Languages Lab
        CONTACT POINT:
                Dr. Henry Lieberman
Carnegie Mellon University
        CONTACT POINT:
                Dr. Brad Myers
                bam@cs.cmu.edu
Macquarie University, Sydney, Australia
We are working on visual language aspects that support parallel program development, and program visualization techniques that assist parallel program debugging and performance tuning. We currently focus on message-passing programming systems.
        CONTACT POINT:
                Dr. Kang Zhang
                Department of Computing
                Macquarie University
                Sydney, NSW 2109
                Australia
                kang@mpce.mq.edu.au

Other newsgroups

comp.lang.prograph discusses Prograph, a commercially available visual programming language, originally for Macs, but soon(?) to be available on a variety of platforms.

comp.soft-sys.khoros discusses various aspects of the Khoros integrated software development environment for information processing and visualization. Khoros includes the visual programming language Cantata.

There is a mailing list for LabVIEW. To subscribe, send a message to: info-labview-request@pica.army.mil.

What are some references for component-based software?

Is anyone familiar with the idea of component based software construction? Any references or pointers to papers, particularly in conjunction with visual programming? I'm familiar with some of the work of Oscar Nierstrasz and the folks at the University of Geneva, as well as some papers which use a visual block diagram metaphor, like Glinert's BLOX, Prograph and Fabrik. Material on how to define a proper component set would be useful as well. Thanks for any info.

Look at Parts, from Digitalk. It is commercial example of what you are talking about.

A couple of books related to the idea were pointed out, such as Grady Booch's "Software Components with Ada". Along the same line is a book I have, "A Systematic Catalogue of Reusable Abstract Data Types" by Jurgen Uhl and Hans Albrecht Schmid (Springer-Verlag, ISBN 0-387-53229-3). Other components libraries can be found in Smalltalk, Gnu G++, the NIH C++ class library. Commercial sources include Digitalk, ParcPlace and Mediashare.

Papers on the subject suggested by others include:

What are some references about visual query languages?

Thom Gillespie's dissertation is titled "VisualMelvyl, a prototype model of a visual interface for an online public access catalog." It includes all the reasoning and every visual element in the interface, hundreds of pictures. Available through UMI as order number 9228661.

I'd also suggest looking at Scott Kim's diss from Stanford on the Visual Computer. He's a graphic artist who did his dissertation with Knuth, very interesting. [Note, at least some readers think that Kim's work has very little, if any, to do with this topic. -DM]

There are a number of visual query language ideas that are not diagrammatic, which may be more helpful to you than the diagrammatic ones. Have you looked in the annual proceedings of the Visual Language Workshops? (title: 19?? IEEE Workshop on Visual Languages). For example, there's an interesting paper in the 1992 proceedings by Del Bimbo et al. in which the query is basically a simplified picture of the desired results. A longer version of that paper appeared in the Journal of Visual Languages and Computing 3(3), Sept. 1992.

What work has been done in specifying visual language grammars?

Much work has been done. Here are some references broken down into the style of grammar used...

References

    @inproceedints{Beguelin91,
	author="A. Beguelin et al.",
	title="Graphical Development Tools for Newtork-Based
		Concurrent Supercomputing",
	booktitle="Proc. Supercomputing 91",
	year="1991",
	address="Albuquerque, NM",
	pages="435-444"}

    @phdthesis{Bell92a,
	author="B. Bell",
	title="Using Programming Walkthroughs to Design a Visual Language",
	school="University of Colorado at Boulder",
	year="1992",
	month="January",
	address="Boulder, Colorado"}

    @inproceedings{Bell92b,
	author="B. Bell and W. Citrin",
	title="Simulation of Communications Protocols through Graphical
		Transformation Rules",
	booktitle="Advanced Visual Interfaces",
	year="1992",
	month="May",
	address="Rome, Italy"}

    @inproceedings{Bell93,
    	author="B. Bell and C. Lewis",
    	title="ChemTrains: A Language for Creating Behaving Pictures",
    	booktitle=vl93,
    	year="1993",
    	pages="188--195",
    	month="August",
    	address="Bergen, Norway"}

    @article{Borning86,
	title="Graphically Defining New Building Blocks in {T}hing{L}ab",
	author="A. Borning",
	journal=hci,
	volume="2",
	year="1986",
	pages="269--295"}

    @article{Brooks87,
	title="No Silver Bullet",
	author="F. P. Brooks, Jr.",
	journal=ieeec,
	month="April",
	year="1987",
	volume="20",
	number="4",
	pages="10--19"}

    @article{Burnett89,
        title="Influence of Visual Technology on the Evolution of
		Language Environments",
        author="A. L. Ambler an M. M. Burnett",
        journal=ieeec,
        year= 1989,
        volume="6",
        number=2,
        pages="9-22",
        month="October"}

    @inproceedings{Burnett92,
    	title="A Declarative Approach to Event-handling in Visual
    	    Programming Languages",
    	author="M. M. Burnett and A. L. Ambler",
    	booktitle=vl93,
    	year="1992",
    	pages="34--40",
    	address="Seattle, Washington",
    	month="September"}

    @inproceedings{Cardelli83,
	title="Two-Dimensional Syntax for Functional Languages",
	author="L. Cardelli",
	booktitle="Integrated Interactive Computing Systems",
	publisher="North Holland",
	year="1983",
	pages="139-151"}

    @book{Chang86,
	title="Visual Languages",
	editor="S.-K. Chang and T. Ichikawa and P. A.
		Ligomenides",
	publisher="Plenum Press",
	year="1986",
	address="New York"}

    @book{Chang90a,
	title="Principles of Visual Programming Systems",
	editor="S.-K. Chang",
	publisher="Prentice Hall",
	year="1990",
	address="New York"}

    @inproceedings{Christensen68,
	title="An Example of the Manipulation of Directed Graphs in the 
		AMBIT/G Programming Language",
	author="C. Christensen",
	booktitle="Interactive Systems for Experimental and Applied
		Mathematics",
	publisher="Academic Press",
	address="New York",
	year="1968"}

    @book{Denert74,
	title="PLAN2D - Towards a Two-Dimensional Programming Language",
	series="Lecture Notes in Computer Science",
	number="26",
	pages="202--213",
	publisher="Springer Verlag",
	year="1974"}

    @inproceedings{Edel86,
	title="The {T}inkertoy Graphical Programming Environment",
	author="M. Edel",
	booktitle="Proc. COMPSAC '86",
	month="October",
	year="1986",
	pages="466--471"}

    @techreport{Ellis69,
	title="The GRAIL Project: An Experiment in Man-Machine 
		Communications",
	author="T. O. Ellis and J. F. Heafner and W. F. Sibley",
	institution="RAND",
	year="1969",
	number="RM-5999-ARPA"}

    @article{Finzer84,
	title="Programming by {R}ehearsal",
	author="W. Finzer and L. Gould",
	journal=byte,
	volume="9",
	number="6",
	month="June",
	year="1984",
	pages="187--210"}

    @inproceedings{Furnas91,
	title="New Graphical Reasoning Models for Understanding Graphical
		Interfaces",
	author="G. W. Furnas",
	booktitle="Proc. CHI '91",
	month="April",
	year="1991",
	pages="71--78"}

    @article{GACote94,
	title="Desktop Telephony"
	author="R. GA Cote",
	journal="Byte",
	number="3",
	volume="19",
	month="March",
	year="1994",
	pages="151--154"}

    @article{Glinert84,
	title="{P}ict: An Interactive Graphical Programming Language",
	author="E. P. Glinert and S. Tanimoto",
	journal=ieeec,
	volume="7",
	number="25",
	month="November",
	year="1984"}

    @techreport{Glinert86a,
	title="{PC--TILES}: A Visual Programming Environment for Personal
		Computers Based on the {BLOX} Methodology",
	author="E. P. Glinert and C. D. Smith",
	institution="Dept. of Computer Science, Rensselaer Polytechnic 
		Institute",
	year="1986",
	number="86--21"}

    @inproceedings{Glinert89,
	title="The User's View of {S}un{P}ict, an Extensible Visual Environment
		for Intermediate--Scale Procedural Programming",
	author="E. P. Glinert and D. W. McIntyre",
	booktitle="Fourth Israel Conference on Computer Systems and
		Software Engineering",
	year="1989",
	month="June 5--6",
	pages="49--58"}

    @book{Glinert90b,
	title="Visual Programming Environments: Paradigms and Systems",
	editor="E. P. Glinert",
	publisher="IEEE Computer Society Press",
	year="1990",
	address="Los Alamitos, CA"}

    @book{Glinert90c,
	title="Visual Programming Environments: Applications and Issues",
	editor="E. P. Glinert",
	publisher="IEEE Computer Society Press",
	year="1990",
	address="Los Alamitos, CA"}

    @phdthesis{Golin90,
	title="A method for the specification and parsing of
		visual languages",
	author="E. J. Golin",
	school="Brown University",
	year="1990"}

    @article{Golin90b,
	title="The Specification of Visual Language Syntax",
	author="E. J. Golin and S. P. Reiss",
	journal=jvlc,
	year="1990",
	number="2",
	volume="1",
	pages="141--157"}

    @article{Golin91c,
	title="Parsing visual languages with picture layout grammars",
	author="E. J. Golin",
	year="1991",
	month="December",
	volume="2",
	number="4",
	journal=jvlc,
	pages="371--394"}

    @inproceedings{G&H93a,
        title="Integrated OO software development in SPE",
        author="J. C. Grundy and J. G. Hosking",
        year="1993",
        month="August",
        booktitle="Proceedings 1993 NZCS Conference",
        pages="465--478",
        address="New Zealand"}

    @inproceedings{G&H93b,
        title="Construction multi-view editing environments using MViews",
        author="J. C. Grundy and J. G. Hosking",
        year="1993",
        month="August",
        booktitle=VL93,
        pages="220--224",
        address="Bergen, Norway"}

    @article{Helm91a,
	title="A declarative specification and semantics for visual 
		languages",
	author="R. Helm and K. Marriott",
	year="1991",
	month="December",
	volume="2",
	number="4",
	journal=jvlc,
	pages="311--332"}

    @article{Heydon90,
	title="Miro: Visual Specification of Security",
	author="A. Heydon and M. W. Maimone and J. D. Tygar and
                      J. M. Wing and A. M. Zaremski",
	journal=ieeese,
	volume="16",
	number="10",
	month="October",
	year="1990",
	pages="1185--1197"}

    @article{Hirakawa90a,
	title="An Iconic Programming System, {HI--VISUAL}",
	author="M. Hirakawa and M. Tanaka and T. Ichikawa",
	journal=ieeese,
	volume="16",
	number="10",
	month="October",
	year="1990",
	pages="1178--1184"}

    @inproceedings{Ichikawa86a,
	title="{HI--VISUAL}: A Language Supporting Visual Interation in
		Programming",
	author="N. Monden and I. Yoshimoto and M. Hirakawa and M. Tanaka
		and T. Ichikawa",
	booktitle=vl84,
	year="1984",
	pages="199--204"}

    @inproceedings{Ingalls88,
	title="{F}abrik -- A Visual Programming Environment",
	author="D. Ingalls and S. Wallace and Y.-Y. Chow and
		F. Ludolph and K. Doyle",
	booktitle=oopsla88,
	year="1988",
	pages="176--190",
	address="San Diego"}

    @techreport{Kimura86c,
    	title="A Visual Langauge for Keyboardless Programming",
    	author="T. D. Kimura and J. W. Choi and J. M. Mack",
    	institution="Washington University",
    	year="1986",
    	number="WUCS--86--6",
    	address="St. Louis, Missouri",
    	month="June"}

    @inproceedings{Kopache88,
	title="{C$^2$}: A Mixed Textual/Graphical Environment for {C}",
	author="M. E. Kopache and E. P. Glinert",
	booktitle=vl88,
	publisher="IEEE Computer Society Press",
	year="1988",
	pages="231--238"}

    @article{LabView,
	title="{LabVIEW}: Laboratory Virtual Instrument Engineering
		Workbench",
	author="G. M. Vose and G. Williams",
	journal=byte,
	pages="84--92",
	month="September",
	year="1986"}

    @inproceedings{Lakin80,
    	title="Computing with Text-Graphic Forms",
    	author="F. Lakin",
    	booktitle="Conference Record of the 1980 LISP Conference",
    	year="1980",
    	pages="100--106",
    	address="Stanford, CA"}

    @incollection{Lakin86,
	title="Spatial Parsing for Visual Languages",
	author="F. Lakin",
	booktitle="Visual Languages",
	editor="S.-K. Chang and T. Ichikawa and P. Ligomenides",
	year="1986",
	address="New York",
	publisher="Plenum Press",
	pages="35--85"}

    @inproceedings{Lakin87,
    	title="Visual Grammars for Visual Languages",
    	author="F. Lakin",
    	booktitle="Proc. 6th Nat. Conf on Artificial Intelligence",
    	year="1987",
    	pages="683--688",
    	address="Seattle, WA"}

    @inproceedings{McIntyre92b,
	title="Visual Tools for Generating Iconic Programming Environments",
	author="D. W. McIntyre and E. P. Glinert",
	month="Sept.",
	year="1992",
	booktitle=vl92,
	pages="162--168",
	address="Seattle, WA."}

    @phdthesis{McIntyre92c,
	title="A Visual Method for Generating Iconic Programming
		Environments",
	author="D. W. McIntyre",
	school="Rensselaer Polytechnic Institute",
	year="1992",
	address="Troy, N.Y."}

    @article{Myers90a,
        title="Taxonomies of Visual Programming and Program Visualization",
        author="B. A. Myers",
        year="1990",
        journal=jvlc
	number="1",
	pages= "97-123",
	volume="1"}

    @inproceedings{Najork91,
    	title="The Cube Language",
    	author="M. Najork and S. Kaplan",
    	booktitle=vl91,
    	year="1991",
    	pages="218--224",
    	address="Kobe, Japan"}

    @inproceedints{Newton92,
	title="The CODE 2.0 Graphical Parallel Programming Language",
	author="P. Newton and J. C. Browne",
	booktitle="Proc. ACM Int. Conf. Supercomputing",
	year="1992",
	month="July"}

    @inproceedings{Norton90,
	author="C. D. Norton and E. P. Glinert",
	title="A Visual Environment for Designing and Simulating Execution
		of Processor Arrays",
	booktitle=vl90,
	year="1990",
	month="October",
	pages="227--232",
	address="Skokie, Illinois"}

    @article{OBrien93,
    	author="L. O'Brien",
    	title="Issues of Programming",
    	journal="Computer Language",
    	month="January",
    	year="1993",
    	pages="45--52",
    	volume="10",
    	number="1"}

    @inproceedings{Piet83,
	author="T. Pietrzykowski and S. Matwin and T. Muldner",
	title="The Programming Language {PROGRAPH}: Yet Another Application
		of Graphics",
	booktitle="Proc. Graphics Interface '83",
	year="1983",
	month="May",
	pages="143--145",
	address="Edmonton, Alberta"}

    @inproceedings{Poswig92,
    	author="J. Poswig and K. Teves and G. Vrankar and C. Moraga",
    	title="VisaVis - Contributions to Practice and Theory of Highly
    	    Interactive Visual Languages",
    	year="1992",
    	booktitle=vl92,
    	pages="155--162",
    	address="Seattle, WA"}

    @book{Shu88,
	author="N. C. Shu",
	title="Visual Programming",
	publisher="Van Nostrand Reinhold",
	year="1988",
	address="New York"}

    @book{Smith77,
	title="Pygmailion - A Computer Program to Model and Stimulate
		Creative Thought",
	author="D. C. Smith",
	publisher="Birkhauser",
	address="Basel",
	year="1977"}

    @article{Smith87,
	title="Experiences with the {A}lternate {R}eality {K}it: An
		Example of the Tension Between Literalism and Magic",
	author="R. B. Smith",
	journal=ieeecga,
	month="September",
	year="1987",
	pages="42--50"}

    @inproceedings{StDenis90,
    	title="Specification by Example using Graphical Animation and
    	    a Production System",
    	author="R. St.-Denis",
    	booktitle="Proc. 23rd Hawaii Intl Conf Syst Sci",
    	year="1990",
    	pages="237--246"}

    @phdthesis{Sutherland66,
	title="On-Line Graphical Specification of Computer Procedures",
	author="W. R. Sutherland",
	institution="MIT",
	address="Cambridge, MA",
	year="1966"}

    @article{Wittenburg91,
	title="Unification--based grammars and tabular parsing for
		graphical languages",
	author="K. Wittenburg and L. Weitzman and J. Talley",
	year="1991",
	month="December",
	volume="2",
	number="4",
	journal=jvlc,
	pages="347--370"}

String definitions used in the above references:

    @string{ieeec = "IEEE Computer"}
    @string{jvlc = "J. Visual Languages and Computing"}
    @string{ieeese = "IEEE Trans. Software Engineering"}
    @string{ieees = "IEEE Software"}
    @string{ieeecga = "IEEE CG \& A"}
    @string{hci = "Human Computer Interaction"}
    @string{toplas = "ACM Trans. Programming Languages and Systems"}
    @string{vl84 = "Proc. 1984 IEEE Workshop Visual Languages"}
    @string{vl86 = "Proc. 1986 IEEE Workshop Visual Languages"}
    @string{vl87 = "Proc. 1987 IEEE Workshop Visual Languages"}
    @string{vl88 = "Proc. 1988 IEEE Workshop Visual Languages"}
    @string{vl89 = "Proc. 1989 IEEE Workshop Visual Languages"}
    @string{vl90 = "Proc. 1990 IEEE Workshop Visual Languages"}
    @string{vl91 = "Proc. 1991 IEEE Workshop Visual Languages"}
    @string{vl92 = "Proc. 1992 IEEE Workshop Visual Languages"}
    @string{vl93 = "Proc. 1993 IEEE Symposium Visual Languages"}
    @string{cacm = "Commun. ACM"}
    @string{byte = "BYTE"}
    @string{oopsla88 = "Proc. OOPSLA '88"}

Daniel LaLiberte (liberte@ncsa.uiuc.edu)
Last modified: Sat Dec 23 21:11:58 CST 1995


Next-in-Thread Next Message
Inline: 1 All Outline: 1 2 All

1 VL'95, Darmstadt, Germany by koschorek@pu.informatik.th-darmstadt.de, 1994, Nov 30
2 Cognitive aspects of visual programming by thomas.green@mrc-apu.cam.ac.uk, 1994, Dec 29

Add to: "Visual Languages References"

Members Subscribe Admin Mode
Show Frames Help


Forum Catagories:
Entertainment and Recreation
  • Sports
  • Music

  • Humanities (Graphics, Images, Photography, Art, Philosophy and Literature)
    Science
    Computers and the WWW
  • Languages/Operating Systems (Java, HTML, Windows)
  • WWW

  • Government and Politics
    Business, Finance, and Economics
    Education
    Society and Culture

    Google
     
    Web www.HyperNews.org