Human Generated Data

Title

Untitled (family portrait in living room)

Date

c. 1950

People

Artist: Lainson Studios,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21873

Human Generated Data

Title

Untitled (family portrait in living room)

People

Artist: Lainson Studios,

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21873

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Clothing 99.9
Apparel 99.9
Person 99.8
Human 99.8
Person 98.9
Person 98.9
Person 98.9
Furniture 98.5
Dress 95.6
Sleeve 95.6
Interior Design 95
Indoors 95
Tie 93.3
Accessories 93.3
Accessory 93.3
Dog 93
Mammal 93
Animal 93
Canine 93
Pet 93
Long Sleeve 88.6
Female 86.7
Suit 84.2
Coat 84.2
Overcoat 84.2
Chair 83.9
Room 82.5
Woman 72.4
Shoe 71.9
Footwear 71.9
Floor 70.9
Lab Coat 69.7
Flooring 68.3
Face 65.8
Shirt 64.1
Girl 63.6
Couch 63.5
Clinic 63.1
People 62.9
Photography 62.7
Photo 62.7
Shorts 60.8
Table 59.4
Curtain 58.1
Flower 56.2
Plant 56.2
Blossom 56.2
Pants 55.8
Blazer 55.5
Jacket 55.5

Clarifai
created on 2023-10-22

people 99.7
wedding 98.5
bride 97.7
woman 96.8
group 96.7
two 96.2
dress 95.6
adult 95.5
veil 95.4
wear 92.7
groom 92
man 91.4
indoors 89.2
three 87.5
room 86.6
monochrome 85.6
furniture 84.5
gown 83.4
bridal 82.2
one 82

Imagga
created on 2022-03-11

people 34
person 29.3
adult 29.2
man 28.9
couple 26.1
happy 25.1
male 25
home 23.9
smiling 21.7
room 21.5
dress 20.8
women 19.8
men 19.8
happiness 19.6
indoors 18.5
portrait 18.1
boutique 18
two 17.8
interior 17.7
professional 17.5
lifestyle 17.3
domestic 16.6
family 15.1
fashion 15.1
house 15
love 15
groom 14.8
standing 14.8
bride 14.7
modern 14.7
casual 14.4
clothing 14
attractive 14
wedding 13.8
indoor 13.7
holding 13.2
together 13.1
life 12.2
lady 12.2
smile 12.1
hospital 11.4
cheerful 11.4
new 11.3
work 11.1
day 11
business 10.9
walking 10.4
style 10.4
senior 10.3
sitting 10.3
holiday 10
joy 10
pretty 9.8
looking 9.6
husband 9.5
marriage 9.5
wife 9.5
corporate 9.4
shop 9.3
mature 9.3
suit 9.2
kitchen 8.9
bouquet 8.9
businessman 8.8
full length 8.7
window 8.7
elegance 8.4
old 8.4
human 8.2
20s 8.2
fun 8.2
office 8.2
teacher 8.2
group 8.1
romantic 8
mother 8
cleaner 8
child 7.7
married 7.7
apartment 7.7
adults 7.6
togetherness 7.6
clothes 7.5
nurse 7.5
one 7.5
father 7.4
camera 7.4
inside 7.4
businesswoman 7.3
handsome 7.1
face 7.1
medical 7.1

Google
created on 2022-03-11

Microsoft
created on 2022-03-11

text 97.7
dress 94.9
indoor 87.1
wedding 84.5
clothing 82.4
person 74.7
woman 70.9
wedding dress 64.7
footwear 61.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 92.7%
Happy 67.4%
Calm 28.3%
Surprised 2%
Sad 0.9%
Disgusted 0.5%
Confused 0.4%
Fear 0.3%
Angry 0.2%

AWS Rekognition

Age 27-37
Gender Female, 87.4%
Calm 97.4%
Happy 1.3%
Surprised 0.5%
Confused 0.3%
Sad 0.3%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Male, 99.2%
Calm 69%
Sad 14.3%
Happy 8.1%
Surprised 4.2%
Confused 2.6%
Angry 0.9%
Disgusted 0.6%
Fear 0.3%

AWS Rekognition

Age 54-62
Gender Male, 93.2%
Happy 74.5%
Sad 8.9%
Calm 4.3%
Confused 4.1%
Surprised 3.2%
Disgusted 2.2%
Fear 1.6%
Angry 1.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person
Tie
Dog
Chair
Shoe
Person 99.8%
Person 98.9%
Person 98.9%
Person 98.9%
Tie 93.3%
Dog 93%
Chair 83.9%
Shoe 71.9%

Categories

Imagga

interior objects 99.9%

Text analysis

Amazon

MN