Human Generated Data

Title

Untitled (large family portrait in living room)

Date

c. 1950

People

Artist: John Howell, American active 1930s-1960s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21858

Human Generated Data

Title

Untitled (large family portrait in living room)

People

Artist: John Howell, American active 1930s-1960s

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21858

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Clothing 99.8
Apparel 99.8
Person 99.5
Human 99.5
Person 99.5
Person 99
Dress 98.5
Person 97.5
Person 96.9
Person 96.4
Person 96.3
Person 95.6
Person 94.8
Person 94.5
Person 94.1
Person 93.8
Face 93.3
Person 92.1
Suit 90.4
Overcoat 90.4
Coat 90.4
Person 89.9
Person 89.6
Female 89.3
Tie 87.3
Accessories 87.3
Accessory 87.3
Chair 86.2
Furniture 86.2
Person 85.7
Stage 82.5
Tie 82.3
Robe 82
Fashion 82
Monitor 81.1
Electronics 81.1
Display 81.1
Screen 81.1
Gown 80.6
People 78.4
Person 76.2
Person 75.8
Shorts 75
Dance Pose 74.4
Leisure Activities 74.4
Portrait 70.4
Photography 70.4
Photo 70.4
Woman 70.3
Wedding 69.6
Indoors 69.1
Girl 68.9
Kid 67.4
Child 67.4
Costume 66.9
Head 60
Wedding Gown 59.7
Crowd 59.6
Table 58.5
Floor 58.3
TV 57.5
Television 57.5
Room 57.2
Bridegroom 57.2
Tuxedo 56.4
Dance 55.8
Shirt 55.3

Clarifai
created on 2023-10-22

people 99.9
group 99.9
many 98.5
group together 98.5
adult 98.4
woman 98.3
man 96.6
wear 95.6
child 93.7
leader 93.2
several 92.6
medical practitioner 89.9
five 89.2
education 87.9
portrait 86
actor 84.6
administration 84.4
music 82.3
outfit 81.7
musician 81.1

Imagga
created on 2022-03-11

person 47.8
man 34.9
people 34.6
teacher 33.3
professional 31
businessman 29.1
male 28.4
adult 27.1
men 24
educator 23.4
business 23.1
couple 20.9
team 19.7
nurse 19.3
happy 18.8
group 18.5
teamwork 17.6
dancer 16.1
work 15.7
performer 14.5
smiling 14.5
job 14.1
together 14
portrait 13.6
women 13.4
crowd 13.4
boss 13.4
businesswoman 12.7
worker 12.6
suit 12.6
meeting 12.2
office 12
student 12
black 12
casual 11.9
love 11.8
happiness 11.7
lifestyle 11.6
smile 11.4
success 11.3
patient 10.6
corporate 10.3
youth 10.2
two 10.2
entertainer 10.1
life 10
silhouette 9.9
holding 9.9
child 9.9
modern 9.8
handsome 9.8
human 9.7
bride 9.6
groom 9.5
bouquet 9.4
sport 9.4
joy 9.2
attractive 9.1
supporter 9
fashion 9
dress 9
world 9
fun 9
nighttime 8.8
audience 8.8
room 8.7
friendship 8.4
wedding 8.3
occupation 8.2
girls 8.2
stage 8.2
case 8.2
player 8.1
cheerful 8.1
symbol 8.1
cheering 7.8
boy 7.8
stadium 7.8
colleagues 7.8
cooperation 7.7
patriotic 7.7
executive 7.6
hand 7.6
businesspeople 7.6
nation 7.6
flag 7.5
leisure 7.5
manager 7.4
style 7.4
lights 7.4
camera 7.4
design 7.3
lady 7.3
exercise 7.3
sexy 7.2
looking 7.2
active 7.2
bright 7.1
clothing 7.1
icon 7.1
sick person 7.1
dance 7.1
employee 7

Google
created on 2022-03-11

Microsoft
created on 2022-03-11

person 98.5
text 98.3
clothing 95.1
posing 83.1
dance 66.8
woman 65.7
footwear 62.4
crowd 0.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 99.8%
Calm 67.3%
Sad 26.6%
Surprised 3.1%
Happy 0.8%
Disgusted 0.7%
Confused 0.6%
Fear 0.5%
Angry 0.4%

AWS Rekognition

Age 23-33
Gender Male, 99.1%
Surprised 39.1%
Calm 20.4%
Sad 17.5%
Happy 9.4%
Angry 8.3%
Fear 2.6%
Disgusted 2.4%
Confused 0.3%

AWS Rekognition

Age 29-39
Gender Female, 65.1%
Surprised 56.4%
Calm 19.3%
Happy 16.9%
Fear 3.7%
Angry 1.1%
Confused 0.9%
Disgusted 0.9%
Sad 0.8%

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 68.2%
Sad 14.1%
Angry 9.9%
Surprised 2.5%
Fear 2.4%
Disgusted 1.3%
Confused 0.8%
Happy 0.6%

AWS Rekognition

Age 29-39
Gender Male, 99%
Calm 90.1%
Happy 4.7%
Sad 2.7%
Surprised 2%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 29-39
Gender Male, 99.3%
Happy 57.8%
Confused 17.7%
Calm 13.7%
Sad 4.6%
Angry 2.2%
Disgusted 2.2%
Surprised 1.5%
Fear 0.4%

AWS Rekognition

Age 40-48
Gender Male, 97.2%
Calm 90.2%
Happy 5.1%
Sad 1.4%
Confused 0.9%
Surprised 0.7%
Disgusted 0.7%
Fear 0.6%
Angry 0.6%

AWS Rekognition

Age 48-56
Gender Male, 99.4%
Happy 79.2%
Calm 19%
Angry 0.5%
Surprised 0.5%
Sad 0.3%
Disgusted 0.3%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 31-41
Gender Male, 98.8%
Calm 97.2%
Sad 2.5%
Surprised 0.1%
Disgusted 0.1%
Angry 0%
Fear 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 33-41
Gender Male, 96.2%
Calm 72.7%
Happy 15.9%
Surprised 3.8%
Disgusted 2.7%
Sad 1.7%
Angry 1.6%
Confused 1.1%
Fear 0.5%

AWS Rekognition

Age 37-45
Gender Male, 96.2%
Happy 98.4%
Sad 0.9%
Surprised 0.4%
Calm 0.1%
Fear 0.1%
Confused 0.1%
Disgusted 0%
Angry 0%

AWS Rekognition

Age 42-50
Gender Male, 99.8%
Happy 46.9%
Calm 29.3%
Disgusted 7.5%
Surprised 6.3%
Confused 6%
Sad 2.6%
Fear 0.8%
Angry 0.7%

AWS Rekognition

Age 39-47
Gender Male, 99.9%
Happy 95.9%
Surprised 1.9%
Calm 0.9%
Sad 0.7%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 48-54
Gender Male, 99.5%
Calm 87.5%
Happy 10.5%
Sad 0.7%
Confused 0.5%
Angry 0.3%
Surprised 0.2%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Male, 58.7%
Calm 89.2%
Fear 8.1%
Sad 0.8%
Surprised 0.7%
Happy 0.4%
Disgusted 0.3%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 33-41
Gender Male, 100%
Sad 94.4%
Angry 1.8%
Surprised 1%
Fear 0.9%
Happy 0.7%
Disgusted 0.4%
Calm 0.4%
Confused 0.3%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Calm 99%
Happy 0.9%
Sad 0%
Confused 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 47-53
Gender Male, 96.6%
Happy 83.5%
Calm 10.1%
Sad 2.7%
Fear 1.3%
Surprised 0.8%
Confused 0.6%
Angry 0.6%
Disgusted 0.4%

AWS Rekognition

Age 23-33
Gender Male, 55.2%
Happy 85.7%
Calm 4.5%
Confused 4.5%
Sad 2.7%
Angry 0.8%
Surprised 0.6%
Disgusted 0.6%
Fear 0.5%

AWS Rekognition

Age 47-53
Gender Male, 100%
Calm 91%
Happy 6.2%
Sad 1%
Confused 0.6%
Angry 0.5%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Person 99.5%
Person 99.5%
Person 99%
Person 97.5%
Person 96.9%
Person 96.4%
Person 96.3%
Person 95.6%
Person 94.8%
Person 94.5%
Person 94.1%
Person 93.8%
Person 92.1%
Person 89.9%
Person 89.6%
Person 85.7%
Person 76.2%
Person 75.8%
Tie 87.3%
Tie 82.3%

Categories

Text analysis

Amazon

5
KODYK-COVELA