Human Generated Data

Title

Untitled (group portrait of men and women with teacups gathered around woman pouring tea)
Date

1950
People

Artist: O. B. Porter Studio, American active 1930s-1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10834

Human Generated Data

Title

Untitled (group portrait of men and women with teacups gathered around woman pouring tea)

People

Artist: O. B. Porter Studio, American active 1930s-1940s

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 99.6
Person 99.6
Person 99.2
Person 99.2
Person 98.9
Person 98.6
Person 97.8
Person 96.3
Person 95.4
People 94.3
Person 93
Person 91.8
Person 90.9
Person 88.5
Clinic 87.7
Person 86.5
Hospital 65.8
Photo 60.2
Photography 60.2
Doctor 59.4
Face 58
Family 57.6
Portrait 56

Imagga
created on 2022-01-29

nurse 63.7
man 30.9
people 29.5
person 28.6
male 28.3
adult 28.3
home 22.3
couple 20.9
men 19.7
happiness 19.6
room 19.5
smiling 18.8
happy 18.8
kin 18.6
businessman 18.5
women 18.2
professional 17.8
indoors 17.6
cheerful 17.1
business 17
sitting 15.4
family 15.1
office 14.4
portrait 13.6
two 13.5
work 13.3
life 13.2
smile 12.8
teacher 12.4
job 12.4
lifestyle 12.3
together 12.3
table 12.2
group 12.1
businesswoman 11.8
holding 11.5
meeting 11.3
team 10.7
husband 10.6
chair 10.5
modern 10.5
love 10.2
indoor 10
musical instrument 9.9
wind instrument 9.8
interior 9.7
talking 9.5
businesspeople 9.5
wife 9.5
clothing 9.4
brass 9.4
senior 9.4
mature 9.3
mother 9.2
house 9.2
dress 9
health 9
color 8.9
patient 8.9
colleagues 8.7
bride 8.6
corporate 8.6
casual 8.5
executive 8.4
communication 8.4
attractive 8.4
worker 8.1
new 8.1
working 7.9
medical 7.9
boy 7.8
married 7.7
exam 7.7
elderly 7.7
enjoying 7.6
adults 7.6
fun 7.5
grandfather 7.4
wedding 7.4
20s 7.3
lady 7.3
child 7.3
suit 7.2

Google
created on 2022-01-29

Black 89.7
Table 76.2
Monochrome photography 74.5
Monochrome 72.9
Vintage clothing 72.5
Event 72.4
Classic 71
Art 69.1
Suit 66.7
Room 66.5
Stock photography 63.9
History 62.4
Photo caption 60.6
Sitting 55.9
Curtain 54.5
Family 53.7
Retro style 51.9
Chair 50.9
Sharing 50.3

Microsoft
created on 2022-01-29

text 96.3
birthday cake 95.8
person 91.7
posing 78.7
wedding cake 75.7
black 67.8
table 63.7
cake 63.6
group 59.6
woman 54.3
clothing 53.1
old 49.6

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 77.3%
Calm 57.3%
Sad 19.6%
Happy 14.4%
Confused 2.6%
Angry 2.3%
Surprised 1.6%
Fear 1.6%
Disgusted 0.6%

AWS Rekognition

Age 31-41
Gender Male, 96.9%
Happy 82.2%
Calm 11.4%
Surprised 4.1%
Sad 1%
Disgusted 0.5%
Confused 0.4%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Calm 89.8%
Sad 4.6%
Happy 4.5%
Angry 0.4%
Surprised 0.2%
Disgusted 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 48-54
Gender Male, 66.9%
Calm 97.4%
Happy 1.2%
Surprised 0.5%
Confused 0.3%
Sad 0.2%
Disgusted 0.2%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 48-56
Gender Female, 63%
Happy 84.2%
Calm 6.6%
Confused 2.4%
Angry 2%
Surprised 1.8%
Sad 1.3%
Disgusted 1%
Fear 0.8%

AWS Rekognition

Age 34-42
Gender Male, 69.2%
Calm 83.8%
Confused 6.1%
Sad 6%
Happy 1.9%
Disgusted 0.7%
Angry 0.6%
Surprised 0.4%
Fear 0.4%

AWS Rekognition

Age 38-46
Gender Male, 95.4%
Happy 69.1%
Calm 28.5%
Surprised 0.6%
Confused 0.5%
Sad 0.5%
Fear 0.3%
Disgusted 0.3%
Angry 0.2%

AWS Rekognition

Age 47-53
Gender Female, 65%
Sad 59.8%
Calm 25%
Happy 4.7%
Confused 4.4%
Surprised 3.2%
Disgusted 1.4%
Angry 0.9%
Fear 0.7%

AWS Rekognition

Age 48-54
Gender Male, 99.6%
Calm 88.2%
Sad 4.9%
Happy 4.1%
Confused 1.4%
Surprised 0.5%
Disgusted 0.5%
Angry 0.4%
Fear 0.1%

AWS Rekognition

Age 50-58
Gender Male, 92.2%
Calm 61.7%
Happy 25.5%
Surprised 7%
Sad 3.7%
Confused 0.6%
Fear 0.6%
Disgusted 0.5%
Angry 0.4%

AWS Rekognition

Age 40-48
Gender Male, 96%
Calm 98.1%
Sad 1.4%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 88.6%
a group of people posing for a photo in front of a window 81.3%
a group of people posing for the camera 81.2%

Text analysis

Amazon

8&D
KODAK-AL

Google

YT3RA2-
A
YT3RA2- A