Human Generated Data

Title

Untitled (family portrait)
Date

c. 1950
People

Artist: Lainson Studios,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21892

Human Generated Data

Title

Untitled (family portrait)

People

Artist: Lainson Studios,

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.21892

Machine Generated Data

Tags

Amazon
created on 2023-10-25

Lamp 100
Architecture 100
Building 100
Furniture 100
Indoors 100
Living Room 100
Room 100
Face 99.6
Head 99.6
Photography 99.6
Portrait 99.6
Table Lamp 99.6
Formal Wear 99.2
Couch 99.1
Person 99.1
Person 99
Adult 99
Male 99
Man 99
People 99
Person 98.9
Adult 98.9
Female 98.9
Woman 98.9
Person 98.2
Adult 98.2
Male 98.2
Man 98.2
Clothing 98.1
Animal 96.5
Canine 96.5
Dog 96.5
Mammal 96.5
Pet 96.5
Coat 94.1
Interior Design 92.7
Dining Room 90.8
Dining Table 90.8
Table 90.8
Dress 90.5
Suit 87.1
Cabinet 81.6
Suit 81.1
Hound 76.6
Jacket 72.2
Chair 71.4
Accessories 63.3
Tie 63.3
Puppy 57.8
Lampshade 57.5
Skirt 57.2
Fireplace 57
Lighting 56.8
Blazer 56.5
Tuxedo 56.5
Chandelier 56.2
Blouse 55.7
Footwear 55.6
Shoe 55.6
Shirt 55.5
Armchair 55.4
Fashion 55.4
Gown 55.4
Pants 55.1

Clarifai
created on 2018-08-23

people 99.9
group 98.8
administration 98.4
leader 97
adult 96.8
room 95.3
canine 95.1
woman 94.7
home 93.7
group together 93.3
chair 93.3
man 92.4
many 91.4
furniture 89.5
actress 89
outfit 88.7
sit 87.4
indoors 86.3
family 86.2
wear 84.7

Imagga
created on 2018-08-23

pooch 49.7
dog 44.6
man 22.8
happy 22.5
canine 21.8
male 20.6
hunting dog 18.6
people 17.8
pet 16.5
adult 16.5
person 15.7
child 15.2
smiling 15.2
home 15.1
terrier 15.1
hound 14.8
senior 14
couple 13.9
fun 12.7
domestic animal 12.5
portrait 12.3
smile 12.1
couch 11.6
trainer 11.3
boy 11.3
old 11.1
holding 10.7
businessman 10.6
kin 10.5
attractive 10.5
sitting 10.3
lifestyle 10.1
family 9.8
lady 9.7
teacher 9.4
room 9.4
cute 9.3
casual 9.3
camera 9.2
20s 9.2
playing 9.1
black 9
dogs 8.8
indoors 8.8
elderly 8.6
face 8.5
business 8.5
puppy 8.4
indoor 8.2
outdoors 8.2
cheerful 8.1
looking 8
kid 8
together 7.9
color 7.8
retirement 7.7
friend 7.6
joy 7.5
student 7.4
clothing 7.3
domestic 7.2
world 7.2
blond 7.2
handsome 7.1
interior 7.1

Google
created on 2018-08-23

photograph 95.9
mammal 92.6
vertebrate 90.4
dog 87.3
dog like mammal 86.6
snapshot 81.8
vintage clothing 80.2
gentleman 78.9
black and white 74.5
human behavior 66.4
house 61.4
picture frame 59.2
family 57.1
table 56.7
carnivoran 54.1
furniture 52

Microsoft
created on 2018-08-23

floor 91.1
person 89.7
indoor 87.8
posing 53.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-21
Gender Female, 63.9%
Happy 97.7%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Calm 0.9%
Confused 0.5%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 47-53
Gender Female, 100%
Happy 99.2%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Confused 0.2%
Angry 0.2%
Calm 0.1%
Disgusted 0.1%

AWS Rekognition

Age 16-22
Gender Female, 100%
Happy 96.9%
Surprised 6.5%
Fear 5.9%
Sad 2.3%
Angry 0.7%
Confused 0.6%
Calm 0.4%
Disgusted 0.3%

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Happy 98.3%
Surprised 6.4%
Fear 6%
Sad 2.2%
Angry 0.4%
Disgusted 0.2%
Confused 0.2%
Calm 0.2%

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 44
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Adult 99%
Male 99%
Man 99%
Female 98.9%
Woman 98.9%
Dog 96.5%
Suit 87.1%
Shoe 55.6%

Text analysis

Amazon

PROOF
DENVER
LAINSON
AINSON
you
The