Human Generated Data

Title

Untitled (family sitting on couch)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17720

Human Generated Data

Title

Untitled (family sitting on couch)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17720

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Furniture 99.8
Person 99.2
Human 99.2
Home Decor 96.8
Chair 96.6
Couch 95.7
Person 91.1
Living Room 86.9
Room 86.9
Indoors 86.9
Person 86.3
Person 85.6
Table 83.7
Table Lamp 83
Lamp 83
Dining Table 66.7
Tablecloth 66.6
People 66.5
Sitting 65.8
Face 64.5
Portrait 63.7
Photography 63.7
Photo 63.7
Person 60.3
Linen 59.8
Clothing 58.6
Apparel 58.6
Flower 55
Plant 55
Blossom 55
Person 53

Clarifai
created on 2023-10-28

people 100
group 99
adult 98.1
child 98
furniture 96.2
woman 95.8
man 95
room 93.5
many 93.5
boy 92.8
group together 92.4
sit 91.9
leader 89.4
several 88.3
education 88
administration 86.7
wear 86.5
recreation 84.6
chair 84.4
seat 84

Imagga
created on 2022-02-26

brass 97.8
wind instrument 78
cornet 60.7
musical instrument 51.3
person 29.9
man 26.9
people 26.8
male 22
sax 20.1
adult 15.8
men 15.4
player 14.7
teacher 13.9
student 13.6
room 13.4
black 13.2
event 12.9
boy 12.2
competition 11.9
business 11.5
sport 11.5
symbol 11.4
group 11.3
happy 11.3
education 11.2
hand 10.6
businessman 10.6
skill 10.6
work 10.2
lights 10.2
training 10.2
silhouette 9.9
classroom 9.9
school 9.9
human 9.7
music 9.6
home 9.6
design 9.6
drawing 9.6
club 9.4
smiling 9.4
blackboard 9.3
dark 9.2
flag 9.2
portrait 9.1
interior 8.8
serve 8.8
audience 8.8
crowd 8.6
patriotic 8.6
bright 8.6
professional 8.5
baritone 8.4
cheerful 8.1
vibrant 7.9
racket 7.8
couple 7.8
cheering 7.8
happiness 7.8
nighttime 7.8
tennis 7.8
teaching 7.8
court 7.8
stadium 7.8
concert 7.8
athlete 7.7
match 7.7
youth 7.7
muscular 7.6
dance 7.6
nation 7.6
senior 7.5
fun 7.5
lifestyle 7.2
icon 7.1
shiny 7.1
family 7.1
modern 7

Google
created on 2022-02-26

Photograph 94.2
Black 90
Table 89.8
Chair 84
Style 83.9
Black-and-white 83.4
Art 79.6
Picture frame 77.7
Snapshot 74.3
Monochrome 73.7
Event 72.4
Monochrome photography 72.1
Vintage clothing 70
Font 69.7
Room 68.4
Sitting 65.2
Stock photography 64.4
Painting 63.4
Visual arts 62.8
Hat 62.1

Microsoft
created on 2022-02-26

text 99.3
drawing 99.2
sketch 96
cartoon 75.8
painting 74.4
old 70
person 51.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 100%
Sad 46.2%
Happy 24%
Angry 10.6%
Disgusted 5.9%
Calm 4.2%
Confused 4.1%
Surprised 2.6%
Fear 2.3%

AWS Rekognition

Age 25-35
Gender Female, 59%
Calm 99.9%
Sad 0%
Surprised 0%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 27-37
Gender Male, 99.5%
Calm 95.7%
Sad 3.5%
Surprised 0.3%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 40-48
Gender Female, 98.2%
Sad 97.9%
Happy 0.6%
Confused 0.4%
Surprised 0.4%
Calm 0.3%
Fear 0.2%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 33-41
Gender Male, 99.1%
Surprised 72.2%
Calm 9.9%
Fear 5.1%
Angry 4.8%
Sad 3.5%
Happy 2.8%
Disgusted 1.5%
Confused 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.2%
Person 91.1%
Person 86.3%
Person 85.6%
Person 60.3%
Person 53%

Categories

Imagga

text visuals 57.7%
paintings art 35.9%
streetview architecture 4.7%

Text analysis

Amazon

27
VOL

Google

27
27