Human Generated Data

Title

Untitled (contact sheet from The Americans)
Date

1955-1956
People

Artist: Robert Frank, American 1924 - 2019
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the artist, 2.2002.646
Copyright

© Robert Frank Estate

Human Generated Data

Title

Untitled (contact sheet from The Americans)

People

Artist: Robert Frank, American 1924 - 2019

Date

1955-1956

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Collage 99.4
Poster 99.4
Advertisement 99.4
Person 90.2
Human 90.2
Indoors 83.7
Shelf 82.6
Interior Design 67.3
Bookcase 66.7
Furniture 66.7
Person 64
Room 63.2
Person 63.1
Shop 57.8
Book 55.8
Person 51.5
Person 44

Imagga
created on 2022-05-28

shop 34.4
mercantile establishment 21.4
tobacco shop 20.5
design 19.1
business 18.8
modern 18.2
web site 17.7
case 16.9
art 16.5
pattern 14.3
place of business 14.2
technology 14.1
window 14.1
old 13.9
digital 13.8
stall 12.7
vending machine 12.7
texture 12.5
graphic 12.4
web 11.9
city 11.6
screen 11.1
furniture 10.9
communication 10.9
vintage 10.7
building 10.6
information 10.6
office 10.6
center 10.6
computer 10.4
corporate 10.3
slot machine 10.2
black 10.2
architecture 10.1
collection 9.9
display 9.5
glass 9.5
paper 9.4
industry 9.4
presentation 9.3
template 9.2
data 9.1
element 9.1
new 8.9
creative 8.8
television 8.8
urban 8.7
high 8.7
grunge 8.5
store 8.5
card 8.5
shelf 8.5
network 8.3
room 8.3
device 8.1
religion 8.1
decoration 8
antique 8
science 8
interior 8
indoors 7.9
colorful 7.9
shoe shop 7.8
space 7.7
wallpaper 7.6
bookcase 7.6
tech 7.6
menu 7.5
close 7.4
church 7.4
retro 7.4
machine 7.3
light 7.3
security 7.3
establishment 7.1
set 7

Google
created on 2022-05-28

Rectangle 89.1
Font 84.4
Black-and-white 83.6
Wall 81.8
Material property 80.1
Art 79.7
Pattern 76.6
Monochrome 76.5
Tints and shades 75.8
Monochrome photography 75.7
Room 70
Design 68.2
Collage 67.6
Screenshot 66.9
Facade 65.3
Shelving 63.8
Stock photography 63
Collection 58.2
Symmetry 58
Square 57.1

Microsoft
created on 2022-05-28

text 99.8
screenshot 89.2
black and white 88.9
indoor 88.3
monochrome 66
shelf 58.9
old 51.2

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 90.9%
Fear 96.2%
Calm 7.3%
Surprised 6.9%
Sad 2.3%
Angry 0.5%
Disgusted 0.4%
Happy 0.4%
Confused 0.2%

AWS Rekognition

Age 18-24
Gender Female, 64.5%
Fear 85.1%
Sad 25.1%
Surprised 12.2%
Happy 2.4%
Calm 1.3%
Angry 0.6%
Disgusted 0.6%
Confused 0.3%

AWS Rekognition

Age 10-18
Gender Female, 67.9%
Calm 60.1%
Confused 24.1%
Surprised 8.4%
Fear 6.6%
Disgusted 4.5%
Sad 3.7%
Angry 1.1%
Happy 1%

AWS Rekognition

Age 22-30
Gender Male, 66.4%
Calm 36%
Sad 14.2%
Fear 13.3%
Confused 12.8%
Angry 11.7%
Surprised 10%
Disgusted 4.1%
Happy 2%

AWS Rekognition

Age 22-30
Gender Male, 97.9%
Calm 92.8%
Surprised 7.1%
Fear 5.9%
Sad 4.2%
Angry 0.4%
Disgusted 0.2%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 23-33
Gender Female, 52.2%
Calm 53.7%
Fear 16%
Confused 13.9%
Sad 8.4%
Surprised 8.1%
Disgusted 1%
Angry 0.8%
Happy 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 90.2%
Book 55.8%

Captions

Microsoft

a shelf filled with books 30.9%
a close up of a shelf 30.8%
a display in a store window 30.7%

Text analysis

Amazon

16
15
20
19
18
17
69
гг
GI
ISE
112
LC

Google

351 17 141920 40141140 Homm AWLINE 820000-1 FRATAR 660
351
17
141920
40141140
Homm
AWLINE
820000-1
FRATAR
660