Human Generated Data

Title

Untitled (large family of eighteen people posing in small room with bookshelf)
Date

1938
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9913

Human Generated Data

Title

Untitled (large family of eighteen people posing in small room with bookshelf)

People

Artist: Martin Schweig, American 20th century

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99.5
Human 99.5
Person 98.9
Person 98.5
Person 97
Person 96.9
Person 96.9
Person 96.8
Person 96.7
Person 95.9
Person 93.7
Clothing 93.5
Apparel 93.5
Person 93.5
Person 93.3
Person 92.5
Accessory 90.6
Tie 90.6
Accessories 90.6
Person 89.9
Person 89.5
Person 87.9
Person 85.4
People 83.4
Person 82.1
Face 74.5
Female 60
Clinic 59
Nurse 57.9
Doctor 56.5
Person 48.7

Imagga
created on 2022-01-29

kin 34.1
nurse 31.1
person 31
man 29.5
male 29.1
people 28.4
couple 21.8
player 20.1
men 19.7
adult 19.2
athlete 17.5
ballplayer 16.4
happy 16.3
family 16
businessman 15.9
contestant 15.4
happiness 14.9
boy 14.8
smiling 14.5
portrait 14.2
child 13.7
group 13.7
world 13.6
black 12.6
business 12.1
sport 12.1
love 11.8
together 11.4
women 11.1
room 11
girls 10.9
professional 10.7
bride 10.5
fun 10.5
friendship 10.3
two 10.2
brass 10.1
dress 9.9
silhouette 9.9
mother 9.9
active 9.9
human 9.7
success 9.6
party 9.4
suit 9
team 9
outdoors 8.9
play 8.6
dance 8.6
smile 8.5
youth 8.5
wedding 8.3
style 8.2
cheerful 8.1
teacher 8.1
lifestyle 7.9
wind instrument 7.9
holiday 7.9
student 7.7
art 7.7
bouquet 7.7
crowd 7.7
old 7.7
casual 7.6
beach 7.6
friends 7.5
retro 7.4
teen 7.3
golfer 7.3
new 7.3
exercise 7.3
groom 7.2
home 7.2
worker 7.2

Google
created on 2022-01-29

Photograph 94.2
Snapshot 74.3
Vintage clothing 74.3
Event 70.6
Room 69.1
Uniform 67.8
Monochrome 67.7
Monochrome photography 66.4
History 66.2
Suit 65.2
Team 64.1
Family reunion 62.5
Stock photography 62.2
Photo caption 62.2
Classic 57.9
Child 57
Retro style 54.4
Family 53.2
Photography 51.7
Font 51

Microsoft
created on 2022-01-29

person 95.9
clothing 94.7
text 79.7
woman 75.2
posing 56.8
wedding dress 50.9

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Male, 92.4%
Calm 80.9%
Happy 15.6%
Surprised 1.3%
Sad 1.1%
Fear 0.4%
Confused 0.3%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 31-41
Gender Male, 96.7%
Calm 86.6%
Confused 4%
Disgusted 2.7%
Sad 2.6%
Surprised 2%
Angry 1%
Fear 0.6%
Happy 0.4%

AWS Rekognition

Age 27-37
Gender Male, 89.8%
Calm 98.9%
Happy 0.4%
Surprised 0.2%
Sad 0.2%
Fear 0.1%
Disgusted 0.1%
Angry 0%
Confused 0%

AWS Rekognition

Age 22-30
Gender Female, 90.6%
Calm 97.8%
Happy 1.3%
Surprised 0.4%
Sad 0.4%
Disgusted 0%
Angry 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 28-38
Gender Female, 95.7%
Calm 99.4%
Surprised 0.3%
Sad 0.2%
Disgusted 0%
Confused 0%
Happy 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 34-42
Gender Male, 99.4%
Calm 98.3%
Sad 0.7%
Surprised 0.4%
Angry 0.3%
Happy 0.2%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 41-49
Gender Male, 50.7%
Calm 77.7%
Happy 21%
Surprised 0.4%
Disgusted 0.3%
Sad 0.3%
Confused 0.2%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 45-51
Gender Male, 90.9%
Happy 65.1%
Sad 10.1%
Surprised 9.7%
Calm 8.6%
Confused 3.3%
Disgusted 2.1%
Angry 0.6%
Fear 0.5%

AWS Rekognition

Age 45-51
Gender Male, 95.2%
Happy 97.5%
Sad 0.9%
Calm 0.5%
Surprised 0.5%
Fear 0.2%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 37-45
Gender Female, 70.3%
Calm 95.1%
Happy 2.1%
Sad 1.2%
Disgusted 0.5%
Confused 0.4%
Surprised 0.3%
Angry 0.3%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 74.2%
Calm 94.2%
Happy 4.1%
Sad 0.4%
Surprised 0.4%
Confused 0.4%
Disgusted 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 41-49
Gender Female, 97.4%
Happy 97.1%
Calm 2.3%
Sad 0.2%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 35-43
Gender Female, 75.7%
Happy 71.8%
Calm 24.2%
Surprised 2.4%
Sad 0.5%
Angry 0.5%
Confused 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 38-46
Gender Male, 80.7%
Calm 82.7%
Sad 5.9%
Happy 5.2%
Surprised 4.2%
Disgusted 0.7%
Confused 0.6%
Angry 0.5%
Fear 0.3%

AWS Rekognition

Age 48-56
Gender Male, 75.4%
Calm 41.5%
Happy 18.2%
Sad 17.3%
Confused 12%
Surprised 5.1%
Disgusted 2.4%
Angry 1.9%
Fear 1.6%

AWS Rekognition

Age 54-62
Gender Male, 99.9%
Calm 85.2%
Happy 13.4%
Surprised 0.4%
Confused 0.4%
Sad 0.2%
Fear 0.2%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 30-40
Gender Male, 99.8%
Calm 99.8%
Happy 0.1%
Sad 0%
Surprised 0%
Angry 0%
Disgusted 0%
Confused 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 90.6%

Captions

Microsoft

a group of people posing for a photo 91.1%
a group of people posing for the camera 91%
a group of people posing for a picture 90.9%

Text analysis

Amazon

MJIR
AROA
MJIR BYEER AROA
losse
BYEER