Human Generated Data

Title

Untitled (family portrait in living room)

Date

c. 1950

People

Artist: Lainson Studios,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21876

Human Generated Data

Title

Untitled (family portrait in living room)

People

Artist: Lainson Studios,

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21876

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Clothing 99.9
Apparel 99.9
Person 99.7
Human 99.7
Furniture 99.6
Person 99.3
Person 99.1
Person 99.1
Dress 98.4
Interior Design 96.3
Indoors 96.3
Female 94.9
Tie 90.8
Accessories 90.8
Accessory 90.8
Home Decor 90.8
Room 88.8
Woman 84.6
Sleeve 82.6
Dog 82.4
Mammal 82.4
Animal 82.4
Canine 82.4
Pet 82.4
Suit 81.7
Coat 81.7
Overcoat 81.7
Floor 79.7
Face 78.5
Flooring 76.3
Chair 75
Shoe 73.5
Footwear 73.5
Girl 68.9
Photography 68
Photo 68
Portrait 67
People 65
Table 64
Shorts 63.5
Long Sleeve 63.3
Shirt 61.4
Curtain 60.2
Couch 60.2
Lab Coat 58.1
Pants 56.4
Door 55.8

Clarifai
created on 2023-10-22

people 99.8
group 97.4
wedding 97.3
woman 96.9
adult 95.6
bride 94.9
dress 94.4
two 93.6
indoors 93.3
veil 91.9
monochrome 91.7
wear 91.5
man 91.4
room 89.7
furniture 85.7
one 85
three 84.8
groom 83.3
leader 80.6
actress 80.5

Imagga
created on 2022-03-11

people 34.6
adult 29
man 28.2
couple 27.9
person 25.9
women 25.3
male 24.9
home 23.9
happy 23.8
smiling 21.7
indoors 21.1
happiness 20.4
men 19.8
groom 19.6
professional 19.3
lifestyle 18.8
dress 18.1
room 16.8
two 16.1
portrait 15.5
hospital 15.3
interior 15
love 15
bride 14.7
lady 14.6
work 14.3
family 14.2
house 14.2
together 14
modern 14
standing 13.9
sitting 13.7
attractive 13.3
businessman 13.2
senior 13.1
clothing 13
corporate 12.9
wedding 12.9
smile 12.8
fashion 12.8
holding 12.4
business 12.1
boutique 12
life 11.7
husband 11.4
nurse 11.4
group 11.3
indoor 11
two people 10.7
full length 10.7
walking 10.4
looking 10.4
day 10.2
domestic 10.2
inside 10.1
communication 10.1
office 10
pretty 9.8
cheerful 9.8
new 9.7
teacher 9.6
suit 9.6
wife 9.5
casual 9.3
teamwork 9.3
businesswoman 9.1
style 8.9
medical 8.8
casual clothing 8.8
bouquet 8.7
hands 8.7
elderly 8.6
holiday 8.6
talking 8.6
marriage 8.5
togetherness 8.5
elegance 8.4
old 8.4
health 8.3
human 8.2
20s 8.2
fun 8.2
kitchen 8.2
team 8.1
romantic 8
mother 7.9
20 24 years 7.9
color 7.8
adults 7.6
joy 7.5
shop 7.5
enjoyment 7.5
worker 7.5
clothes 7.5
success 7.2
educator 7.1
patient 7.1
bedroom 7

Google
created on 2022-03-11

Microsoft
created on 2022-03-11

text 97.5
person 90.9
dress 83.6
wedding 81
clothing 80.4
footwear 77.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 95.7%
Calm 98.6%
Happy 0.7%
Disgusted 0.3%
Confused 0.2%
Sad 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 91%
Happy 82.3%
Calm 10.7%
Surprised 3.1%
Fear 2.3%
Disgusted 0.6%
Sad 0.4%
Confused 0.3%
Angry 0.3%

AWS Rekognition

Age 25-35
Gender Male, 96.9%
Calm 95.6%
Happy 3.1%
Disgusted 0.4%
Sad 0.3%
Surprised 0.2%
Confused 0.2%
Fear 0.2%
Angry 0.1%

AWS Rekognition

Age 40-48
Gender Male, 99.6%
Sad 70.7%
Happy 13.1%
Confused 5.7%
Calm 5.5%
Surprised 1.4%
Fear 1.3%
Disgusted 1.3%
Angry 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Dog
Chair
Shoe
Person 99.7%
Person 99.3%
Person 99.1%
Person 99.1%
Tie 90.8%
Dog 82.4%
Chair 75%
Shoe 73.5%

Categories

Imagga

interior objects 99.9%

Text analysis

Amazon

ca

Google

MJI-YT3A -XAGO ca
MJI-YT3A
-XAGO
ca