Ai, Design and Heritage

Data Torture
“Data” for Design Decisions, what Architects should do?

Presented by
Ar. Suwardana Winata, IAI
for
SSO#32 –Universitas Tarumanagara
6 Maret2024
 Artificial Intelligence

a machine capable of perceiving,

recognizing and identifying its
surroundings without any human
training or control
Frank Rosenblatt (1958)
 Timeline AI technology

https://towardsdatascience.com/the-advent-of-architectural-ai-706046960140
How the AI associated
“understand”
Us?
Input text

picture
The Practice of Architecture
The Practice of Architecture
Architecture and DATA
Is data driven the design or using data to find the design?
Using a broad data base of
formatted internal layouts,
recent research projects have
studied this model’s ability to
learn space programming and
furnishing patterns
Source: Stanislas Chailou, Artificial intelligence and architecture Internal layout generation. “Input
output” pairs, for various user-specified constraints. By S. Chaillou.
facade
facade
Form-Sampling, Not Form-Finding
 AI in Architecture
The Potential of GANs
Real-Time Rendering. (Generative Adversarial
Networks)

Virtual Reality (VR) and

Augmented Reality
(AR).
Hal ini disukai Arsitek?
Atau
Momok untuk profesi Arsitek?
AI in Architecture (till now)
• Automated Design
Generation.
• Precision Modelling
• Real-Time Design Changes
• Intelligent Resource
Management.
•AI, at its core, is a multidisciplinary
approach that incorporates aspects of
computer science, psychology, and
sophisticated mathematics to create
systems capable of learning, reasoning,
problem-solving, perception, and language
comprehension.
 AI Technology –till 2024

• Deep Learning
• Machine Learning
• Natural Language
Understanding
• Speech Recognition
• Virtual Agents
• Expert Systems
• Decision Management
• Robotic Process Automation
• Text Analytics
Its implementation in the realm of
architecture has led to a paradigm shift in
how professionals plan, design, optimize and
manage buildings and infrastructure projects.
AI, Heritage and Design
Source: https://heritagesciencejournal.springeropen.com/articles/10.1186/s40494-023-01035-x
https://leica-geosystems.com/nl-nl/case-studies/reality-capture/scanning-damaged-heritage-sites-in-ukraine
Source: Pavlos Chatzigrigoriou, Is Architecture Connected with Intangible Cultural Heritage? Reflections from Architectural
Digital Documentation and Interactive Application Design in Three Aegean Islands (April 2021)
A generative adversarial network (GAN)
is a deep learning architecture. It trains
two neural networks to compete against
each other to generate more authentic
new data from a given training dataset.
For instance, you can generate new
images from an existing image database
or original music from a database of
songs.
Data for Generative Adversarial Network
Basic methods of GAN
 Generative Adversarial Networks and Heritage architecture

Source: Ceng Sun., Automatic generation of architecture facade for historical urban renovation using generative
adversarial network (https://www.sciencedirect.com/science/article/abs/pii/S0360132322000300)
Source: Hongpan, Lin.Research on the Application of CGAN in the Design of Historic Building Facades in
Urban Renewal—Taking Fujian Putian Historic Districts as an Example (https://www.mdpi.com/2075-
5309/13/6/1478).

the traditional wooden building facades in this area are the characteristic
architectural features of this area. The materials and craftsmanship of the
doors, windows, and walls of its building facades have unique local
characteristics

Data processing. First, clean and filter the data to remove noise and low-
quality images to ensure the quality of the data. Second, label and classify the
data, and classify the data according to the following three types of pictures:

CGAN is a generative model that learns the mapping between input images
and target styles during training. The researcher need to choose an
appropriate loss function and optimizer to improve the accuracy and stability
of the model.

Model evaluation is commonly used evaluation methods include looking at the

LOSS value in the training log and at the test pictures of each generation in
the model iteration.
Source: Hongpan, Lin.Research on the Application of CGAN in the Design of Historic Building Facades in
Urban Renewal—Taking Fujian Putian Historic Districts as an Example (https://www.mdpi.com/2075-
5309/13/6/1478).
Source: Hongpan, Lin.Research on the Application of CGAN in the Design of Historic Building Facades in
Urban Renewal—Taking Fujian Putian Historic Districts as an Example (https://www.mdpi.com/2075-
5309/13/6/1478).
Source: Hongpan, Lin.Research on the Application of CGAN in the Design of Historic Building Facades in
Urban Renewal—Taking Fujian Putian Historic Districts as an Example (https://www.mdpi.com/2075-
5309/13/6/1478).
 DATA Challenges

1. Anyone who has used Machine Learning knows that THE SUCCESS of the system can
only be as good as THE QUANTITY and QUALITY OF DATA to which the system is
exposed.
2. the issue is not how ML can be used in Architecture Engineering Construction Operation
but rather HOW THE INDUSTRY CAN DEVELOP A STRUCTURED DATA PIPELINE tailored
to and appropriate for ML workflows.
3. The challenge that the above process poses has led many researchers to THE USE OF
SYNTHETIC DATASETS – that is, data artificially generated – rather than original datasets
– data collected from actual events or experiments.
 Questioning AI

1. Intention, intention is driven by a multitude of local conditions.

Need operator to do that, that can be missed judgment and
unfeasible.
2. Technical competence, makes AI inaccessible.
3. Intellectual property. If AI can learn from us, whose hold the
copy right.
4. AI need to be attractive and compatible with creative process.
 Forget ‘style’
(when machine make
decision)
 Baroque
Set of categorization, such as
the presence of fluted
columns, ellipses, and
voluptuous figures define a
Baroque object

Rocco
The Generative Adversarial Network learning about ‘style’

Set of vast image (collect from IoT)

Gothic
Image
Specific
character

Rocco
StyleGAN

Source: https://towardsdatascience.com/explained-a-style-based-generator-architecture-for-gans-generating-and-tuning-realistic-6cb2be0f431
 The Problems of AI

Neural Networks:
1. Lack the ability for a crucial discussion
around aspects of style referring to why a
building has come into being.
2. Motivations behind the design, such as a
particular theory, ideology, or political
conviction, are a priori missing when
training/ collecting datasets or in labeling.
 The Problems of AI

In the context of machine vision, style refers

to how architecture is manifest; it indicates
the specific ornamental motives, material
palette, color, pattern, construction, and
technical systems (capture in
image/visualization), So that Hadid or Gehry
can be style
 The Problems of AI

In Data driven-style:
the definition of style within the realm of
Architecture starts to change, transform,
mutate, and produce new and strange
objects.
These generated objects are not a copy of
existing styles, even though those objects are
based on existing data in the form of
historical architecture images.
 The Problems of AI

In Data driven-style:
the definition of style within the realm
of Architecture starts to change, 1. Aspects of
transform, mutate, and produce new interpolation
and strange objects. within a dataset.
These generated objects are not a copy Why?
2. Aspects of
of existing styles, even though those
objects are based on existing data in extrapolation.
the form of historical architecture 3. Invention
images.
 Neural network generate image by
interpolating data sheet, baroque and
modern architecture

Source: Artificial intelligence and architecture (p179)

 linguistic

semantic

a rule-based
design process

Shape grammar

Parametric modelling
Semantic problems:
1. The formulation of abstraction
2. Polysemic potential.
3. One to many –technical challenge.

Context
Such as typological,
cultural, or demographic
information
Closing but not yet
1. The presence of Artificial Intelligence (AI) in Architecture may still be
in its early days. But it evolve along with what AI learn.
2. AI is a partner to analyze to diagnose and to design. It is not just a
smart tool anymore, AI can mimic human thinking pattern.
3. AI need to learn from data that feed to them. Data is AI life source,
more data more faster and more smarter AI think
4. Data should be “clean”. As partner, AI must feed with clean and
healthy data, that the responsible of the feeder.
5. Who trains whose? AI can build their system based on network data
which is in IoT that automatically feed the AI and processed
simultaneously.
6. Architect still need to learn to make decision. Everything is digested
by AI and AI will give so many possible that probably human can
think.
Thank you