Human Generated Data

Title

Untitled (couple seated at table at wedding reception)
Date

1941
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.8622
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couple seated at table at wedding reception)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.7
Human 99.7
Person 99.4
Clothing 99.1
Apparel 99.1
Person 98.6
Suit 95.9
Overcoat 95.9
Coat 95.9
Meal 90.4
Food 90.4
Furniture 84.1
Dish 82.7
Glass 79.9
Shirt 79.7
Face 79.1
Drink 79.1
Beverage 79.1
Female 77.4
Table 75.9
Tuxedo 75.7
Dating 71.9
Alcohol 70.1
Chair 69
Dining Table 68.5
Bridegroom 65.1
Wedding 65.1
Gown 64.4
Fashion 64.4
Finger 63.3
Woman 62.4
Robe 59.9
Wedding Gown 56
Bar Counter 55.9
Pub 55.9
Party 55.1

Imagga
created on 2022-01-09

man 42.3
person 37.2
senior 35.6
male 34
people 29
couple 28.7
patient 23.1
adult 22.8
home 22.3
elderly 22
mature 21.4
nurse 20.7
happy 20.1
medical 18.5
indoors 18.4
retired 18.4
professional 18.1
men 17.2
smiling 16.6
husband 16.3
grandfather 16.2
specialist 16.1
old 16
hospital 14.3
love 14.2
room 14
together 14
health 13.9
sitting 13.7
lifestyle 13.7
worker 13.6
retirement 13.4
married 13.4
wife 13.3
doctor 13.2
portrait 12.9
older 12.6
work 12.6
looking 12
happiness 11.8
laboratory 11.6
care 11.5
office 11.2
women 11.1
coat 10.8
holding 10.7
two people 10.7
family 10.7
face 10.7
cheerful 10.6
loving 10.5
photographer 10.3
sick person 10.2
glasses 10.2
occupation 10.1
case 10
aged 10
grandma 9.8
to 9.7
enjoying 9.5
meeting 9.4
smile 9.3
business 9.1
clinic 9.1
teacher 8.9
70s 8.9
businessman 8.8
scientist 8.8
medicine 8.8
60s 8.8
partner 8.7
table 8.7
exam 8.6
illness 8.6
research 8.6
adults 8.5
togetherness 8.5
enjoyment 8.4
study 8.4
camera 8.3
active 8.2
lab coat 8.2
school 8.1
team 8.1
pensioner 8
citizen 7.9
sixties 7.8
day 7.8
grandmother 7.8
surgery 7.8
education 7.8
discussion 7.8
lab 7.8
chemistry 7.7
busy 7.7
casual 7.6
two 7.6
talking 7.6
biology 7.6
outdoors 7.5
inside 7.4
indoor 7.3
confident 7.3
businesswoman 7.3
student 7.2
stethoscope 7.1
device 7.1
science 7.1
job 7.1
interior 7.1
working 7.1
look 7

Google
created on 2022-01-09

Shirt 94
Vision care 91.3
Smile 90.9
Black 89.6
Flash photography 86.8
Black-and-white 85.7
Gesture 85.3
Style 84
Eyewear 83.5
Happy 82.3
T-shirt 76.9
Monochrome photography 75.6
Font 74.4
Monochrome 72.7
Event 72.1
Shorts 71.6
Sunglasses 71.3
Vintage clothing 70.4
Fun 65.2
Sitting 62.2

Microsoft
created on 2022-01-09

person 99.5
text 94
clothing 87.8
concert 78.3
human face 72.8
man 68.5
black and white 63.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 99%
Happy 33.5%
Calm 25.7%
Sad 21%
Confused 8.5%
Disgusted 4.4%
Surprised 3.4%
Angry 1.9%
Fear 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a man and a woman sitting in front of a window 60.5%
a man and woman sitting next to a window 58%
a man and a woman taking a selfie 57.9%

Text analysis

Amazon

18
18 042.
042.

Google

18 042.
042.
18