Human Generated Data

Title

Untitled (family reunion portrait taken in living room)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3032

Human Generated Data

Title

Untitled (family reunion portrait taken in living room)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3032

Machine Generated Data

Tags

Amazon
created on 2022-01-21

Human 99.6
Person 99.6
Person 99.6
Person 99.1
Person 98.9
Person 98.9
Person 98
Person 97.9
Person 97.5
Person 97.1
Person 97
Person 97
Person 95.7
Accessories 95.7
Tie 95.7
Accessory 95.7
Clothing 92.2
Apparel 92.2
Person 87.7
Person 78.6
People 76.5
Face 65.9
Crowd 65.1
Indoors 65
Shoe 64.3
Footwear 64.3
Room 62.2
Person 61.3
Chair 61.3
Furniture 61.3
Advertisement 59.7
Poster 59
Stage 58.9
Shorts 56.4

Clarifai
created on 2023-10-26

people 99.9
group 99.6
group together 98.7
many 97.9
man 97.4
woman 96.9
education 96.8
adult 96.6
child 91.4
school 90.4
victory 81.3
teacher 80.5
several 77.1
leader 75.1
wear 73.3
five 72.8
partnership 72.5
actor 71.9
uniform 71.2
elementary school 69.1

Imagga
created on 2022-01-21

brass 37
wind instrument 30.8
person 28
people 27.9
man 27.9
silhouette 26.5
male 23.5
musical instrument 21.8
black 19.8
men 19.7
businessman 16.8
sport 16.2
adult 15.3
player 14.9
couple 14.8
group 14.5
boy 13.9
business 13.4
active 13
youth 11.9
dancer 11.4
fun 11.2
contestant 10.9
sunset 10.8
team 10.7
happy 10.6
performer 10.4
child 10.4
party 10.3
gymnasium 10.1
exercise 10
art 9.9
hand 9.9
human 9.7
success 9.6
women 9.5
love 9.5
happiness 9.4
lifestyle 9.4
friendship 9.4
athlete 9.3
two 9.3
dance 9.3
golfer 9.2
power 9.2
dark 9.2
leisure 9.1
kin 9.1
portrait 9.1
style 8.9
family 8.9
together 8.8
play 8.6
friends 8.4
professional 8.4
cornet 8.3
fashion 8.3
teen 8.3
athletic facility 8.2
teenager 8.2
girls 8.2
fitness 8.1
suit 8.1
body 8
celebration 8
life 7.9
attractive 7.7
sign 7.5
joy 7.5
runner 7.4
guy 7.3
facility 7.2
smile 7.1
summer 7.1
ball 7
sky 7

Google
created on 2022-01-21

Font 81.5
Snapshot 74.3
Team sport 69.9
Event 69.7
Art 67.9
Suit 65.9
Room 65.3
Monochrome photography 64.1
Illustration 63.6
Monochrome 63.6
Team 61.5
Crew 57.9
Photo caption 57.9
Vintage clothing 57.6
Classic 57.4
Advertising 57.4
Visual arts 53.2
Chair 52.9
Player 52.2
Sitting 51.7

Microsoft
created on 2022-01-21

person 98.2
text 98
player 94.2
clothing 91.4
man 77.3
drawing 73.2
cartoon 54.3
posing 40.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Sad 82.9%
Calm 9.8%
Happy 3.7%
Angry 1.4%
Disgusted 0.7%
Confused 0.6%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 37-45
Gender Male, 97.8%
Calm 96.6%
Happy 1.3%
Surprised 1.2%
Disgusted 0.3%
Angry 0.2%
Confused 0.1%
Sad 0.1%
Fear 0%

AWS Rekognition

Age 50-58
Gender Male, 99.8%
Calm 32.1%
Happy 24.5%
Sad 22.2%
Angry 7.1%
Disgusted 6.2%
Confused 3.7%
Surprised 3.2%
Fear 0.8%

AWS Rekognition

Age 26-36
Gender Male, 90.1%
Calm 65.3%
Surprised 29.7%
Confused 1.3%
Happy 1%
Disgusted 0.9%
Sad 0.9%
Angry 0.4%
Fear 0.4%

AWS Rekognition

Age 47-53
Gender Male, 99.7%
Happy 90.9%
Sad 5.5%
Angry 1%
Calm 0.7%
Confused 0.6%
Disgusted 0.6%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 45-51
Gender Male, 99.8%
Calm 65.5%
Happy 16.1%
Fear 9.3%
Surprised 4.3%
Confused 2%
Sad 1%
Angry 0.9%
Disgusted 0.8%

AWS Rekognition

Age 40-48
Gender Male, 92.3%
Sad 46.6%
Surprised 14.9%
Happy 13.1%
Calm 12%
Angry 6.4%
Disgusted 2.9%
Fear 2.1%
Confused 2.1%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Sad 35.2%
Angry 24.6%
Happy 15.6%
Calm 9.8%
Surprised 8.5%
Fear 3.1%
Disgusted 1.6%
Confused 1.5%

AWS Rekognition

Age 27-37
Gender Female, 51.3%
Calm 86.7%
Happy 12.6%
Sad 0.1%
Confused 0.1%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 23-33
Gender Male, 100%
Happy 94.3%
Angry 1.7%
Calm 1.2%
Sad 1.2%
Surprised 0.7%
Confused 0.3%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 21-29
Gender Male, 99.3%
Happy 74.8%
Calm 17.6%
Sad 3.2%
Fear 2.1%
Surprised 0.9%
Angry 0.6%
Disgusted 0.5%
Confused 0.3%

AWS Rekognition

Age 49-57
Gender Male, 82.4%
Calm 81.9%
Happy 8.6%
Confused 3.6%
Sad 2.1%
Disgusted 1.7%
Surprised 1%
Angry 0.7%
Fear 0.5%

AWS Rekognition

Age 28-38
Gender Male, 99.8%
Happy 43%
Sad 38.5%
Angry 8%
Fear 3.7%
Surprised 1.9%
Calm 1.8%
Disgusted 1.7%
Confused 1.5%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Calm 63.1%
Surprised 11.4%
Sad 9.3%
Happy 7.3%
Confused 3.7%
Fear 3.4%
Angry 1.1%
Disgusted 0.8%

AWS Rekognition

Age 39-47
Gender Male, 99.3%
Sad 47.5%
Calm 23.1%
Happy 21.3%
Angry 2%
Fear 1.8%
Disgusted 1.7%
Surprised 1.4%
Confused 1.1%

AWS Rekognition

Age 43-51
Gender Male, 100%
Calm 88.2%
Happy 6.8%
Angry 2%
Sad 1.4%
Disgusted 0.6%
Confused 0.5%
Surprised 0.4%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 95.7%
Shoe 64.3%

Text analysis

Amazon

RODVK
RODVK COVEETX FT
COVEETX
FT