Human Generated Data

Title

Untitled (large family portrait in living room)

Date

c. 1950

People

Artist: John Howell, American active 1930s-1960s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21858

Human Generated Data

Title

Untitled (large family portrait in living room)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Clothing 99.8
Apparel 99.8
Person 99.5
Human 99.5
Person 99.5
Person 99
Dress 98.5
Person 97.5
Person 96.9
Person 96.4
Person 96.3
Person 95.6
Person 94.8
Person 94.5
Person 94.1
Person 93.8
Face 93.3
Person 92.1
Coat 90.4
Overcoat 90.4
Suit 90.4
Person 89.9
Person 89.6
Female 89.3
Accessory 87.3
Tie 87.3
Accessories 87.3
Chair 86.2
Furniture 86.2
Person 85.7
Stage 82.5
Tie 82.3
Robe 82
Fashion 82
Monitor 81.1
Display 81.1
Screen 81.1
Electronics 81.1
Gown 80.6
People 78.4
Person 76.2
Person 75.8
Shorts 75
Dance Pose 74.4
Leisure Activities 74.4
Photography 70.4
Photo 70.4
Portrait 70.4
Woman 70.3
Wedding 69.6
Indoors 69.1
Girl 68.9
Child 67.4
Kid 67.4
Costume 66.9
Head 60
Wedding Gown 59.7
Crowd 59.6
Table 58.5
Floor 58.3
TV 57.5
Television 57.5
Room 57.2
Bridegroom 57.2
Tuxedo 56.4
Dance 55.8
Shirt 55.3

Imagga
created on 2022-03-11

person 47.8
man 34.9
people 34.6
teacher 33.3
professional 31
businessman 29.1
male 28.4
adult 27.1
men 24
educator 23.4
business 23.1
couple 20.9
team 19.7
nurse 19.3
happy 18.8
group 18.5
teamwork 17.6
dancer 16.1
work 15.7
performer 14.5
smiling 14.5
job 14.1
together 14
portrait 13.6
women 13.4
crowd 13.4
boss 13.4
businesswoman 12.7
worker 12.6
suit 12.6
meeting 12.2
office 12
student 12
black 12
casual 11.9
love 11.8
happiness 11.7
lifestyle 11.6
smile 11.4
success 11.3
patient 10.6
corporate 10.3
youth 10.2
two 10.2
entertainer 10.1
life 10
silhouette 9.9
holding 9.9
child 9.9
modern 9.8
handsome 9.8
human 9.7
bride 9.6
groom 9.5
bouquet 9.4
sport 9.4
joy 9.2
attractive 9.1
supporter 9
fashion 9
dress 9
world 9
fun 9
nighttime 8.8
audience 8.8
room 8.7
friendship 8.4
wedding 8.3
occupation 8.2
girls 8.2
stage 8.2
case 8.2
player 8.1
cheerful 8.1
symbol 8.1
cheering 7.8
boy 7.8
stadium 7.8
colleagues 7.8
cooperation 7.7
patriotic 7.7
executive 7.6
hand 7.6
businesspeople 7.6
nation 7.6
flag 7.5
leisure 7.5
manager 7.4
style 7.4
lights 7.4
camera 7.4
design 7.3
lady 7.3
exercise 7.3
sexy 7.2
looking 7.2
active 7.2
bright 7.1
clothing 7.1
icon 7.1
sick person 7.1
dance 7.1
employee 7

Google
created on 2022-03-11

Microsoft
created on 2022-03-11

person 98.5
text 98.3
clothing 95.1
posing 83.1
dance 66.8
woman 65.7
footwear 62.4
crowd 0.5

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 99.8%
Calm 67.3%
Sad 26.6%
Surprised 3.1%
Happy 0.8%
Disgusted 0.7%
Confused 0.6%
Fear 0.5%
Angry 0.4%

AWS Rekognition

Age 23-33
Gender Male, 99.1%
Surprised 39.1%
Calm 20.4%
Sad 17.5%
Happy 9.4%
Angry 8.3%
Fear 2.6%
Disgusted 2.4%
Confused 0.3%

AWS Rekognition

Age 29-39
Gender Female, 65.1%
Surprised 56.4%
Calm 19.3%
Happy 16.9%
Fear 3.7%
Angry 1.1%
Confused 0.9%
Disgusted 0.9%
Sad 0.8%

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 68.2%
Sad 14.1%
Angry 9.9%
Surprised 2.5%
Fear 2.4%
Disgusted 1.3%
Confused 0.8%
Happy 0.6%

AWS Rekognition

Age 29-39
Gender Male, 99%
Calm 90.1%
Happy 4.7%
Sad 2.7%
Surprised 2%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 29-39
Gender Male, 99.3%
Happy 57.8%
Confused 17.7%
Calm 13.7%
Sad 4.6%
Angry 2.2%
Disgusted 2.2%
Surprised 1.5%
Fear 0.4%

AWS Rekognition

Age 40-48
Gender Male, 97.2%
Calm 90.2%
Happy 5.1%
Sad 1.4%
Confused 0.9%
Surprised 0.7%
Disgusted 0.7%
Fear 0.6%
Angry 0.6%

AWS Rekognition

Age 48-56
Gender Male, 99.4%
Happy 79.2%
Calm 19%
Angry 0.5%
Surprised 0.5%
Sad 0.3%
Disgusted 0.3%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 31-41
Gender Male, 98.8%
Calm 97.2%
Sad 2.5%
Surprised 0.1%
Disgusted 0.1%
Angry 0%
Fear 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 33-41
Gender Male, 96.2%
Calm 72.7%
Happy 15.9%
Surprised 3.8%
Disgusted 2.7%
Sad 1.7%
Angry 1.6%
Confused 1.1%
Fear 0.5%

AWS Rekognition

Age 37-45
Gender Male, 96.2%
Happy 98.4%
Sad 0.9%
Surprised 0.4%
Calm 0.1%
Fear 0.1%
Confused 0.1%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 42-50
Gender Male, 99.8%
Happy 46.9%
Calm 29.3%
Disgusted 7.5%
Surprised 6.3%
Confused 6%
Sad 2.6%
Fear 0.8%
Angry 0.7%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Happy 95.9%
Surprised 1.9%
Calm 0.9%
Sad 0.7%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 48-54
Gender Male, 99.5%
Calm 87.5%
Happy 10.5%
Sad 0.7%
Confused 0.5%
Angry 0.3%
Surprised 0.2%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Male, 58.7%
Calm 89.2%
Fear 8.1%
Sad 0.8%
Surprised 0.7%
Happy 0.4%
Disgusted 0.3%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 33-41
Gender Male, 100%
Sad 94.4%
Angry 1.8%
Surprised 1%
Fear 0.9%
Happy 0.7%
Disgusted 0.4%
Calm 0.4%
Confused 0.3%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Calm 99%
Happy 0.9%
Sad 0%
Confused 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 47-53
Gender Male, 96.6%
Happy 83.5%
Calm 10.1%
Sad 2.7%
Fear 1.3%
Surprised 0.8%
Confused 0.6%
Angry 0.6%
Disgusted 0.4%

AWS Rekognition

Age 23-33
Gender Male, 55.2%
Happy 85.7%
Calm 4.5%
Confused 4.5%
Sad 2.7%
Angry 0.8%
Surprised 0.6%
Disgusted 0.6%
Fear 0.5%

AWS Rekognition

Age 47-53
Gender Male, 100%
Calm 91%
Happy 6.2%
Sad 1%
Confused 0.6%
Angry 0.5%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 87.3%

Captions

Microsoft

a group of people posing for a photo 85.5%
a group of people posing for the camera 85.4%
a group of people posing for a picture 85.3%

Text analysis

Amazon

5
KODYK-COVELA