Human Generated Data

Title

Untitled (contact sheet from The Americans)
Date

1955-1956
People

Artist: Robert Frank, American 1924 - 2019
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the artist, 2.2002.645
Copyright

© Robert Frank Estate

Human Generated Data

Title

Untitled (contact sheet from The Americans)

People

Artist: Robert Frank, American 1924 - 2019

Date

1955-1956

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the artist, 2.2002.645

Copyright

© Robert Frank Estate

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Collage 100
Advertisement 100
Person 97.2
Human 97.2
Person 96
Person 93.2
Person 92.9
Person 86.4
Shelf 83.6
Person 82
Person 77.7
Screen 67.7
Electronics 67.7
Monitor 66.9
Display 66.9
Building 66.2
Suit 64
Clothing 64
Coat 64
Overcoat 64
Apparel 64
Nature 63.3
Person 61.4
Outdoors 61.2
Person 59.3
Urban 59.2
Silhouette 58.9
Indoors 57.2
City 56.5
Town 56.5
Housing 56.2
Poster 52.7

Clarifai
created on 2023-10-30

people 99.2
monochrome 98
shelf 97.8
group 97.6
commerce 96.9
many 96.5
no person 96.1
stock 93.4
adult 92.2
one 91.3
collage 90.8
man 90.6
street 90.4
container 89.8
home 88.6
wear 87.9
market 87.8
business 87.6
art 86.6
reflection 85.3

Imagga
created on 2022-05-28

window 25.9
window shade 25.8
window blind 20.6
business 19.4
building 19.2
modern 18.9
glass 17.2
architecture 16.7
art 15.9
design 15.7
blind 15.4
technology 14.8
vending machine 14.4
structure 14.1
furniture 14.1
screen 13.7
urban 13.1
pattern 13
protective covering 12.9
web 12.7
black 12.6
slot machine 12.5
office 12.2
digital 12.1
menu 12.1
corporate 12
frame 11.8
old 11.8
device 11.8
city 11.6
interior 11.5
bookcase 11.4
texture 11.1
shop 10.9
machine 10.9
new 9.7
windows 9.6
tech 9.5
industry 9.4
shelf 9.4
colorful 9.3
film 9.3
inside 9.2
template 9.2
collection 9
cafeteria 8.9
information 8.8
television 8.8
graphic 8.7
text 8.7
light 8.7
stained 8.6
furnishing 8.5
room 8.5
communication 8.4
covering 8.4
sky 8.3
vintage 8.3
futuristic 8.1
decoration 8
science 8
work 7.9
paper 7.8
high 7.8
center 7.8
3d 7.7
fare 7.7
cathedral 7.7
card 7.6
network 7.5
framework 7.5
element 7.4
style 7.4
church 7.4
retro 7.4
banner 7.3
restaurant 7.3
data 7.3
computer 7.3
lines 7.2
religion 7.2
shadow 7.2
market 7.1
book 7

Google
created on 2022-05-28

Rectangle 90.7
Human 89.8
Black 89.5
Font 85
Black-and-white 84.7
Art 81.8
Wall 81.4
Material property 80.2
Collage 79.7
People 79
Tints and shades 76.5
Monochrome photography 76.4
Monochrome 76.4
Pattern 74.6
Parallel 71.9
Room 68.3
Eyelash 62.9
Stock photography 62.3
Visual arts 61.3
Symmetry 57.3

Microsoft
created on 2022-05-28

text 98.4
indoor 94.1
black and white 88.3
screenshot 70.7
monochrome 54.8
shelf 52.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Male, 99.6%
Calm 84.5%
Surprised 6.6%
Angry 6.1%
Fear 6%
Sad 3.9%
Confused 2.9%
Disgusted 0.8%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 88.4%
Surprised 6.5%
Fear 6.1%
Angry 6.1%
Sad 2.6%
Confused 2.3%
Happy 0.7%
Disgusted 0.3%

AWS Rekognition

Age 20-28
Gender Male, 76.5%
Calm 44.6%
Fear 32.4%
Happy 11.6%
Disgusted 6.9%
Surprised 6.8%
Confused 2.9%
Sad 2.6%
Angry 1.2%

AWS Rekognition

Age 41-49
Gender Female, 89.5%
Sad 86.9%
Calm 47.3%
Fear 7.2%
Surprised 6.9%
Angry 3.2%
Confused 3%
Disgusted 1.3%
Happy 0.6%

AWS Rekognition

Age 22-30
Gender Male, 99.7%
Surprised 35.2%
Disgusted 27.6%
Fear 21.9%
Calm 12.7%
Sad 7%
Angry 1.7%
Happy 1.3%
Confused 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.2%
Poster 52.7%

Categories

Imagga

text visuals 78.6%
interior objects 16.8%
paintings art 3.5%

Captions

Text analysis

Amazon

13
PRE
14
ESID
Yea,
HAPPY!
97
EA
SIDEM

Google

KECAMA
RODAR
SAFETY
FILM
!
ttt
MTX
1014
HAPPY
6
Yea
CAREE ttt 13 KOTAK KECAMA RODAR SAFETY FILM HAPPY! ttt SIDEN FILM MTX 1014 HAPPY! LESID 6 Yea, HAPPY!
CAREE
13
KOTAK
SIDEN
LESID
,