Human Generated Data

Title

Untitled (two formally dressed couples in front of a living room fireplace)
Date

1937
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12064
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two formally dressed couples in front of a living room fireplace)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Furniture 100
Dining Table 99.1
Table 99.1
Person 98.9
Human 98.9
Chair 98.9
Person 98.8
Tabletop 97
Home Decor 96.8
Restaurant 96.6
Room 96.5
Indoors 96.5
Dining Room 96.5
Interior Design 93.1
Meal 89.6
Food 89.6
Person 89.2
Cafe 83.1
Living Room 81.5
Couch 77.2
Clothing 76.8
Apparel 76.8
Dish 74.3
Flooring 73.4
Shelter 72
Building 72
Nature 72
Rural 72
Outdoors 72
Countryside 72
Female 70.7
People 70.2
Sitting 67.9
Dress 66.3
Tie 64
Accessories 64
Accessory 64
Kid 63.2
Child 63.2
Face 62.2
Person 61.9
Girl 61.8
Overcoat 59.9
Coat 59.9
Suit 59.9
Cafeteria 59.3
Plant 58.4
Linen 57.8
Food Court 56.8
Flower 55.9
Blossom 55.9
Floor 55.4

Imagga
created on 2022-01-15

kin 44.2
man 36.3
male 29.1
people 28.4
person 27.9
nurse 26.4
adult 25
happy 21.9
smiling 21
patient 20.6
sitting 19.8
family 17.8
men 17.2
senior 16.9
couple 16.5
business 16.4
mother 16.3
hospital 16.1
home 15.2
women 15
indoors 14.9
portrait 14.9
room 14.8
cheerful 14.6
30s 14.4
businessman 14.1
old 13.9
two 13.5
mature 13
lifestyle 13
smile 12.8
father 12.6
happiness 12.5
medical 12.4
child 12.1
casual 11.9
elderly 11.5
shop 11.4
sick person 11.4
case 11.2
love 11
20s 11
team 10.7
colleagues 10.7
mid adult 10.6
husband 10.6
boy 10.4
life 10.3
aged 10
40s 9.7
interior 9.7
thirties 9.7
together 9.6
education 9.5
table 9.5
dad 9.4
groom 9.3
holiday 9.3
indoor 9.1
classroom 9
grandfather 8.8
parent 8.8
retired 8.7
day 8.6
married 8.6
four 8.6
wife 8.5
face 8.5
chair 8.4
blackboard 8.4
camera 8.3
occupation 8.2
working 8
color 7.8
two people 7.8
gift 7.7
retirement 7.7
bride 7.7
twenties 7.6
businesspeople 7.6
seller 7.5
barbershop 7.4
school 7.2
teacher 7.1
job 7.1
pensioner 7

Google
created on 2022-01-15

Chair 84
Adaptation 79.3
Art 78.7
Monochrome 74.9
Monochrome photography 72.3
Room 70.7
Vintage clothing 70.5
Classic 67
Picture frame 63.4
Event 63
History 59.9
Sitting 58.8
Suit 57.6
Visual arts 55.2
Illustration 53.6

Microsoft
created on 2022-01-15

text 95.7
wedding dress 89.9
furniture 88.8
dress 86.1
clothing 84.9
bride 83.8
black and white 83.7
table 81.6
woman 80
chair 75.6
person 74.8
vase 71.3
flower 66.6

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 81.3%
Calm 99.9%
Surprised 0%
Happy 0%
Confused 0%
Sad 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 65.2%
Calm 99.6%
Sad 0.2%
Happy 0.1%
Confused 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 7-17
Gender Female, 70.6%
Calm 71.5%
Sad 24.9%
Disgusted 1.5%
Happy 0.6%
Confused 0.6%
Fear 0.4%
Angry 0.3%
Surprised 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Chair 98.9%
Tie 64%

Captions

Microsoft

a group of people posing for a photo 68.5%
a group of people in a room 68.4%
a group of people standing in a room 68.3%

Text analysis

Amazon

5387
over
PELEMOEN 206 over
206
PELEMOEN

Google

5397
5397