Human Generated Data

Title

We Travelled in Moonlight
Date

2018
People

Artist: Herman Rahman, Singaporean born 1993
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Richard and Ronay Menschel Fund for the Acquisition of Photographs, 2019.252
Copyright

© Herman Rahman, courtesy of A.I. Gallery

Human Generated Data

Title

We Travelled in Moonlight

People

Artist: Herman Rahman, Singaporean born 1993

Date

2018

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2020-04-05

Collage 100
Advertisement 100
Human 96.6
Person 96.6
Person 95.7
Person 88.1
Person 81.4
Person 70.8
Person 70.3
Person 69.8
Poster 65
Brochure 58.7
Flyer 58.7
Paper 58.7
Person 51.5

Clarifai
created on 2020-04-05

people 99.5
collage 99.2
set 96.6
group 96.2
man 95.8
adult 95
woman 94.9
monochrome 94.8
no person 94.1
collection 93.7
portrait 93.3
retro 92.6
desktop 90.9
illustration 89.1
wear 88.9
vintage 88.5
music 88.1
many 87.3
one 86.1
art 84.8

Imagga
created on 2020-04-05

money 32.3
currency 27.8
cash 25.6
business 23.1
finance 22.8
banking 22
paper 21.7
bank 20.9
case 20.9
fastener 18.3
wealth 17.9
symbol 17.5
locker 17.4
dollar 16.7
set 16.3
financial 16
investment 15.6
design 14.7
device 14.6
exchange 14.3
sign 14.3
bill 14.3
note 13.8
restraint 13.7
stamp 13.6
icon 13.4
economy 13
letter 12.8
grunge 12.8
collection 12.6
dollars 12.6
market 12.4
old 11.8
hundred 11.6
text 11.3
stock 11.2
black 10.9
vintage 10.7
us 10.6
success 10.5
commerce 10.3
savings 10.2
notes 9.6
retro 9
drawing 8.9
graphic 8.7
bills 8.7
communication 8.4
clock 8.3
comic book 8.3
sketch 8.3
pattern 8.2
technology 8.2
object 8.1
banknote 7.8
finances 7.7
trade 7.6
texture 7.6
house 7.5
element 7.4
new 7.3
group 7.3
colors 7

Google
created on 2020-04-05

Photograph 96.7
Photographic paper 85.6
Snapshot 85.5
Collection 79.8
Black-and-white 78.1
Room 74.4
Photography 72.5
Art 65.5
History 54.1

Microsoft
created on 2020-04-05

text 99.1
cartoon 86.8
white 83.2
gallery 77.3
clothing 73.8
different 71.8
person 70.6
bunch 62.9
many 61.1
several 10.5

Face analysis

Amazon

Google

AWS Rekognition

Age 20-32
Gender Male, 50.6%
Surprised 45.3%
Happy 45.1%
Sad 47.3%
Angry 48.5%
Fear 45.1%
Calm 48.2%
Disgusted 45.3%
Confused 45.2%

AWS Rekognition

Age 33-49
Gender Male, 53.7%
Angry 45.2%
Calm 49.3%
Surprised 47.1%
Happy 45.9%
Fear 47.3%
Disgusted 45%
Sad 45.2%
Confused 45%

AWS Rekognition

Age 32-48
Gender Male, 54.8%
Fear 45%
Calm 54.3%
Sad 45%
Confused 45%
Disgusted 45%
Happy 45.3%
Angry 45%
Surprised 45.3%

AWS Rekognition

Age 45-63
Gender Male, 54.7%
Happy 45%
Calm 54.5%
Fear 45%
Disgusted 45%
Confused 45%
Sad 45.2%
Surprised 45%
Angry 45.2%

AWS Rekognition

Age 13-25
Gender Male, 50.8%
Fear 45%
Sad 48.9%
Happy 45%
Calm 50.5%
Angry 45.4%
Confused 45.1%
Surprised 45%
Disgusted 45.1%

AWS Rekognition

Age 32-48
Gender Female, 50.2%
Confused 45.1%
Sad 47.8%
Angry 45.5%
Calm 50.2%
Disgusted 45.1%
Fear 46.1%
Surprised 45.1%
Happy 45.1%

AWS Rekognition

Age 22-34
Gender Female, 51.3%
Confused 45.1%
Angry 45.6%
Surprised 45.1%
Sad 52.3%
Happy 45.3%
Calm 45.2%
Fear 46.3%
Disgusted 45.1%

AWS Rekognition

Age 36-54
Gender Male, 50.6%
Sad 45.9%
Confused 45.1%
Disgusted 45.1%
Happy 45%
Fear 45.4%
Calm 51.4%
Surprised 46.7%
Angry 45.4%

AWS Rekognition

Age 39-57
Gender Male, 50.4%
Angry 45.3%
Calm 49%
Sad 48.1%
Fear 45.3%
Disgusted 45.1%
Confused 45.1%
Surprised 45.1%
Happy 47%

AWS Rekognition

Age 16-28
Gender Male, 97.1%
Calm 8.7%
Fear 10.2%
Happy 14.8%
Sad 45.5%
Disgusted 2.6%
Angry 11.7%
Surprised 3.3%
Confused 3.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.6%
Poster 65%

Captions

Microsoft

a black and white photo 38.5%

Text analysis

Amazon

E-e
HEENE
HESE
6:
e

Google

he sitenh ngter Bomber Grp Al epan In the fields Etaal Agpearne f Seme fresen to Same living and Fig. 32. Witness Old Mrs. Liu. DUT ICT -10°C Is the might when inseets were discovered
he
sitenh
ngter
Bomber
Grp
Al
epan
In
the
fields
Etaal
Agpearne
f
Seme
fresen
to
Same
living
and
Fig.
32.
Witness
Old
Mrs.
Liu.
DUT
ICT
-10°C
Is
might
when
inseets
were
discovered