Human Generated Data

Title

Untitled (portrait of family in living room)
Date

c. 1950
People

Artist: Lainson Studios,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21883

Human Generated Data

Title

Untitled (portrait of family in living room)

People

Artist: Lainson Studios,

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21883

Machine Generated Data

Tags

Amazon
created on 2023-10-25

Architecture 99.9
Building 99.9
Furniture 99.9
Indoors 99.9
Living Room 99.9
Room 99.9
Lamp 99.9
Formal Wear 99.6
People 99.4
Photography 99.3
Clothing 99.2
Person 99
Person 98.9
Adult 98.9
Male 98.9
Man 98.9
Person 98.5
Adult 98.5
Male 98.5
Man 98.5
Person 98.5
Table Lamp 97.9
Couch 97.4
Animal 97.1
Canine 97.1
Dog 97.1
Mammal 97.1
Pet 97.1
Face 96.5
Head 96.5
Portrait 96.5
Dress 95.3
Suit 89.7
Suit 87.8
Interior Design 84.8
Coat 81.6
Dining Room 79.1
Dining Table 79.1
Table 79.1
Fireplace 68.3
Hound 67.5
Chair 61.5
Puppy 61.2
Accessories 57.9
Tie 57.9
Bulldog 57.7
Jacket 57.7
Skirt 56.8
Cabinet 56.7
Tuxedo 56.7
Blazer 56.6
Lighting 56.5
Fashion 56.5
Gown 56.5
Chandelier 56.3
Lampshade 56.2
Blouse 56.2
Bridegroom 55.5
Wedding 55.5

Clarifai
created on 2018-08-23

people 99.8
group 97.8
adult 96.3
administration 95.9
leader 95.4
woman 94.4
man 93.5
indoors 93.3
room 92.3
chair 91.9
wear 90.7
outfit 90.3
furniture 90.1
home 88.5
group together 87
sit 86.9
canine 86.5
actress 86.1
family 83.5
two 79.3

Imagga
created on 2018-08-23

home 30.3
room 26.1
people 25.1
person 23.6
interior 21.2
man 20.8
happy 20
house 19.2
indoors 18.4
male 18.1
adult 18
child 15.9
indoor 14.6
smile 14.2
sitting 13.7
lifestyle 13
portrait 12.9
covered couch 12.7
couch 12.5
blond 12.3
business 12.1
attractive 11.9
sofa 11.8
smiling 11.6
family 11.5
businessman 11.5
fun 11.2
litter 11.1
girls 10.9
teacher 10.8
holding 10.7
lady 10.5
couple 10.4
work 10.3
inside 10.1
pretty 9.8
cheerful 9.7
chair 9.7
boy 9.6
women 9.5
living 9.5
happiness 9.4
casual 9.3
life 9.2
fashion 9
blackboard 8.9
kid 8.9
sexy 8.8
looking 8.8
clothing 8.7
table 8.6
cute 8.6
furniture 8.5
two 8.5
old 8.3
student 8.3
dress 8.1
new 8.1
uniform 8.1
office 8
day 7.8
conveyance 7.7
pooch 7.6
laptop 7.6
covering 7.5
joy 7.5
floor 7.4
shop 7.3
playing 7.3
cup 7.2
color 7.2
team 7.2
kin 7.1
professional 7
architecture 7

Google
created on 2018-08-23

photograph 95.5
mammal 92.6
vertebrate 90.4
dog like mammal 81.8
snapshot 81.8
dog 81.1
vintage clothing 79.6
human behavior 72.8
picture frame 68.2
house 67
table 65.6
furniture 64.6
gentleman 64
family 58.6
carnivoran 57.5

Microsoft
created on 2018-08-23

wall 99
floor 92.8
indoor 90.8
old 57.3
posing 49.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 37-45
Gender Female, 99.6%
Happy 79.7%
Calm 8.5%
Surprised 8.4%
Fear 6.4%
Angry 3.9%
Sad 2.5%
Confused 1.3%
Disgusted 0.6%

AWS Rekognition

Age 10-18
Gender Male, 99%
Calm 50.2%
Confused 28.5%
Surprised 7.7%
Fear 6.2%
Sad 5.6%
Happy 5.2%
Angry 4.7%
Disgusted 1%

AWS Rekognition

Age 22-30
Gender Female, 97.4%
Calm 74.1%
Confused 12.1%
Surprised 7.2%
Fear 6.1%
Happy 5.8%
Sad 3%
Angry 2.5%
Disgusted 0.8%

AWS Rekognition

Age 34-42
Gender Male, 100%
Happy 96%
Surprised 6.7%
Fear 6%
Sad 2.2%
Calm 2%
Confused 0.5%
Angry 0.2%
Disgusted 0.1%

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 19
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Adult 98.9%
Male 98.9%
Man 98.9%
Dog 97.1%
Suit 89.7%

Text analysis

Amazon

PROOF
DENVER
LAINSON