Human Generated Data

Title

Untitled (couple seated in the back seat of a car)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8387
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple seated in the back seat of a car)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8387

Copyright

© Estate of Joseph Janney Steinmetz

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Apparel 100
Clothing 100
Hat 99
Human 97.5
Person 96.5
Suit 95.1
Overcoat 95.1
Coat 95.1
Robe 94.9
Fashion 94.9
Gown 94.3
Person 93.1
Face 91.2
Female 90.4
Wedding 89.1
Bridegroom 87
Bride 83.9
Wedding Gown 83.9
Plant 82.9
Dress 82.3
Woman 75.8
Portrait 71.1
Photography 71.1
Photo 71.1
Chair 71
Furniture 71
Flower 70.9
Blossom 70.9
Text 67.6
Tuxedo 67
Head 66.9
Flower Arrangement 65.8
People 64.3
Poster 63.6
Advertisement 63.6
Nature 61.3
Sun Hat 61
Man 60.8
Girl 60
Outdoors 59.7
Collage 58.2
Table 56.2
Flower Bouquet 55.9

Clarifai
created on 2023-10-25

people 99.4
veil 98.2
man 96.9
monochrome 95.9
adult 95.7
woman 95.5
two 91.7
group 90.9
lid 90.8
indoors 89.8
sit 88.3
retro 86.2
vehicle 86.1
music 83.6
nostalgia 82.1
sitting 82
interaction 81.4
fedora 80.5
transportation system 80.4
wear 80

Imagga
created on 2022-01-09

person 39.4
man 31.6
people 30.7
adult 30.6
patient 29.8
male 25.5
lifestyle 18.8
room 17.1
device 17
portrait 16.2
indoors 15.8
happy 15.7
home 15.1
nurse 14.9
work 14.9
human 14.2
hospital 14.2
medical 14.1
professional 14
smiling 13.7
sitting 13.7
smile 13.5
case 13.3
bed 13.3
health 13.2
doctor 13.2
couple 13.1
cheerful 13
face 12.8
indoor 12.8
business 12.7
love 12.6
sick person 12.6
oxygen mask 12.2
men 12
breathing device 11.9
happiness 11.7
seat 11.7
office 11.7
newspaper 11.7
businessman 11.5
leisure 10.8
uniform 10.7
attractive 10.5
women 10.3
model 10.1
treatment 10.1
holding 9.9
worker 9.8
job 9.7
medicine 9.7
product 9.3
surgeon 9.3
plane seat 9.3
relaxation 9.2
horizontal 9.2
inside 9.2
modern 9.1
equipment 9
team 9
chair 8.9
illness 8.6
casual 8.5
two 8.5
clothing 8.5
salon 8.4
relax 8.4
fashion 8.3
occupation 8.2
content 7.7
couch 7.7
support 7.7
pretty 7.7
student 7.7
resting 7.6
hand 7.6
relationship 7.5
suit 7.5
lady 7.3
creation 7.3
dress 7.2
looking 7.2
hair 7.1
specialist 7.1
interior 7.1

Google
created on 2022-01-09

Hat 91.9
Gesture 85.3
Sun hat 84.1
Style 83.8
Fedora 83.6
Black-and-white 83.2
Headgear 81.2
Font 77.9
Art 75.7
Monochrome photography 74.7
Monochrome 73.1
Costume hat 68.8
Vintage clothing 67.8
Event 65.8
Room 65.6
Classic 64.1
Fashion accessory 64.1
Photo caption 63.2
Stock photography 62.5
Cowboy hat 61.1

Microsoft
created on 2022-01-09

text 98.7
fashion accessory 89.8
hat 75.7
black and white 71.6
white goods 67.7
human face 65.8
clothing 65.7
person 60.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 16-22
Gender Male, 91.5%
Calm 86.6%
Happy 6.4%
Surprised 4.4%
Angry 0.9%
Sad 0.6%
Disgusted 0.5%
Confused 0.4%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99%
Person 96.5%

Captions

Text analysis

Amazon

AT
12213
ARRIVING
U.R.N.
12213.
12213. ARRIVING AT J.B'S.
U.R.N. 5~11-40.
5~11-40.
J.B'S.
RODVA
EVERTA RODVA
EVERTA

Google

J.
R.N.
12213 J. R.N. 5~11-40. 12213. ABRIVING AT J.B'S.
12213
5~11-40.
12213.
ABRIVING
AT
J.B'S.