Human Generated Data

Title

Untitled (family portrait, formal clothes, china cabinet and large clock)

Date

c.1930

People

Artist: Harris & Ewing, American 1910s-1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22239

Human Generated Data

Title

Untitled (family portrait, formal clothes, china cabinet and large clock)

People

Artist: Harris & Ewing, American 1910s-1940s

Date

c.1930

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Person 99.5
Human 99.5
Person 99
Person 98.9
Clothing 98.7
Apparel 98.7
Person 98.6
Person 98.4
Person 98
Person 97.9
Person 97.8
Person 96.8
Person 96.4
People 95.8
Person 95.2
Family 87.8
Accessory 86.7
Tie 86.7
Accessories 86.7
Person 83.8
Face 73.2
Person 69.7
Robe 62.3
Fashion 62.3
Coat 59
Suit 59
Overcoat 59
Wedding 57.5
Gown 57.1
Photography 57
Photo 57
Female 55.4
Wedding Gown 55.1
Person 50.6
Person 46.3

Imagga
created on 2022-03-11

person 41.3
brass 37.7
people 34.6
wind instrument 29.8
man 27.5
adult 25
male 24.8
men 23.2
nurse 22.3
cornet 21.3
musical instrument 19.9
couple 18.3
player 17.8
happy 16.9
kin 16.5
professional 16.1
happiness 15.7
group 15.3
women 15
businessman 15
sport 15
portrait 14.9
lifestyle 13.7
suit 13.5
love 13.4
dark 13.4
business 13.4
together 13.1
smiling 13
youth 12.8
human 12.7
fun 12.7
black 12.6
athlete 12.3
smile 12.1
worker 12
exercise 11.8
life 11.8
contestant 11.3
party 11.2
silhouette 10.8
handsome 10.7
crowd 10.6
patient 10.4
two 10.2
training 10.2
guy 10.1
clothing 9.9
fashion 9.8
attractive 9.8
dance 9.7
style 9.6
uniform 9.6
performer 9.5
sitting 9.4
casual 9.3
singer 9.2
leisure 9.1
girls 9.1
modern 9.1
dress 9
cheerful 8.9
dancer 8.8
boy 8.7
ballplayer 8.6
corporate 8.6
golfer 8.5
teacher 8.5
musician 8.5
pretty 8.4
event 8.3
teenager 8.2
office 8
family 8
looking 8
celebration 8
home 8
art 8
job 8
defense 7.8
practice 7.7
fight 7.7
bride 7.7
togetherness 7.5
joy 7.5
active 7.5
holding 7.4
teamwork 7.4
wedding 7.4
groom 7.2
bright 7.1
night 7.1
summer 7.1

Google
created on 2022-03-11

White 92.2
Black 89.9
Black-and-white 85.6
Style 84.1
Picture frame 76.8
Suit 76.1
Monochrome 74.3
Music 74.2
Monochrome photography 74
Event 73.7
Classic 70.5
Entertainment 70.2
Crew 69.4
Vintage clothing 68.4
Room 65.4
Font 64.8
Formal wear 64.6
Team 63.9
Eyewear 63.3
Stock photography 62.9

Microsoft
created on 2022-03-11

person 99.5
clothing 94.9
posing 92.2
text 91.9
man 89.8
standing 80.9
group 72.6
old 56.2

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 98.8%
Happy 90.2%
Calm 3%
Surprised 2.3%
Sad 1.9%
Angry 0.8%
Fear 0.8%
Disgusted 0.8%
Confused 0.2%

AWS Rekognition

Age 35-43
Gender Male, 99.5%
Happy 52.6%
Confused 18.6%
Calm 12.7%
Sad 7.4%
Surprised 5.4%
Disgusted 2.2%
Angry 0.7%
Fear 0.3%

AWS Rekognition

Age 31-41
Gender Female, 94.9%
Happy 90.7%
Sad 2.9%
Surprised 1.9%
Calm 1.5%
Disgusted 1%
Confused 0.8%
Fear 0.7%
Angry 0.5%

AWS Rekognition

Age 27-37
Gender Male, 90%
Happy 46.6%
Calm 30.5%
Surprised 18.8%
Disgusted 2%
Fear 0.8%
Confused 0.6%
Angry 0.4%
Sad 0.3%

AWS Rekognition

Age 31-41
Gender Male, 74.9%
Calm 50.7%
Surprised 23%
Happy 19.9%
Sad 1.8%
Angry 1.5%
Fear 1.3%
Disgusted 1.3%
Confused 0.5%

AWS Rekognition

Age 37-45
Gender Male, 97.6%
Calm 52.9%
Happy 26.9%
Sad 7.3%
Surprised 5%
Angry 2.8%
Disgusted 1.9%
Confused 1.9%
Fear 1.3%

AWS Rekognition

Age 39-47
Gender Female, 90.1%
Happy 54.2%
Surprised 27.7%
Calm 13.5%
Confused 1.3%
Disgusted 1.2%
Sad 1.2%
Angry 0.7%
Fear 0.3%

AWS Rekognition

Age 31-41
Gender Male, 56.9%
Happy 79.4%
Surprised 11.1%
Calm 5%
Fear 1.3%
Angry 1%
Confused 0.9%
Disgusted 0.7%
Sad 0.6%

AWS Rekognition

Age 30-40
Gender Male, 82.1%
Happy 87.9%
Sad 5.5%
Calm 4.2%
Confused 0.6%
Angry 0.6%
Disgusted 0.5%
Surprised 0.4%
Fear 0.4%

AWS Rekognition

Age 31-41
Gender Male, 96.7%
Happy 54.8%
Sad 28.5%
Calm 7.5%
Confused 4.5%
Surprised 1.8%
Angry 1.4%
Disgusted 1.1%
Fear 0.5%

AWS Rekognition

Age 48-54
Gender Male, 98.5%
Happy 85.2%
Calm 7.4%
Surprised 4.7%
Sad 1.5%
Confused 0.4%
Disgusted 0.3%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 40-48
Gender Male, 98.2%
Calm 99.3%
Happy 0.3%
Sad 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Female, 72.9%
Happy 50.4%
Calm 27.5%
Sad 6.1%
Fear 4.7%
Angry 4.2%
Surprised 4%
Confused 1.8%
Disgusted 1.5%

AWS Rekognition

Age 38-46
Gender Male, 98.2%
Calm 59.9%
Happy 23.6%
Surprised 13.4%
Disgusted 1%
Confused 0.8%
Sad 0.5%
Angry 0.4%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 86.7%

Captions

Microsoft

a group of people posing for a photo 95%
a group of people posing for the camera 94.9%
a group of people posing for a picture 94.8%

Text analysis

Amazon

USA
T-2156-0

Google

UTII
UTII