Human Generated Data

Title

Untitled (three boys with model train set)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17752

Human Generated Data

Title

Untitled (three boys with model train set)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17752

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Room 99.4
Indoors 99.4
Person 99.1
Human 99.1
Person 98.3
Person 94.8
Dressing Room 90.7
Sitting 87.9
Bedroom 84
Furniture 79.1
People 75.3
Person 73.7
Interior Design 63.3
Portrait 60.2
Photography 60.2
Face 60.2
Photo 60.2
Living Room 59.3
Dorm Room 58.6

Clarifai
created on 2023-10-29

people 99.8
monochrome 99.1
adult 98.9
wear 98.3
woman 98.2
two 98.1
group 97.9
furniture 97.1
administration 95.5
man 94.9
commerce 91.8
three 91.5
child 91.4
cooking 90.7
room 89.2
home 88.3
indoors 86.5
leader 86.2
one 85.6
family 85.4

Imagga
created on 2022-02-26

room 20
table 19.4
interior 17.7
house 17.5
desk 16.2
musical instrument 15.8
people 15.6
drawing 15.4
business 15.2
furniture 14.4
modern 14
design 12.9
home 12.8
architecture 12.7
building 12.3
man 12.1
window 12.1
balcony 12.1
shop 12.1
male 12
men 12
wall 12
percussion instrument 11.8
person 11.5
work 11.3
sketch 11
glass 10.9
decor 10.6
group 10.5
light 10
city 10
office 9.7
businessman 9.7
indoors 9.7
urban 9.6
finance 9.3
chair 9.1
decoration 8.7
lamp 8.7
mercantile establishment 8.6
apartment 8.6
classroom 8.4
floor 8.4
old 8.4
silhouette 8.3
technology 8.2
happy 8.1
success 8
graphic 8
lifestyle 7.9
women 7.9
equipment 7.8
grunge 7.7
structure 7.6
art 7.5
sign 7.5
worker 7.4
manager 7.4
facade 7.4
vibraphone 7.4
computer 7.3
indoor 7.3
smiling 7.2
kitchen 7.1

Google
created on 2022-02-26

Black 89.6
Black-and-white 86.4
Table 85.7
Style 84
Window 83.2
Tableware 78.3
Monochrome 77.7
Monochrome photography 76.2
Room 70.1
Curtain 68.6
Design 68.3
Cooking 67.6
Event 66.7
Stock photography 63.7
Sitting 61.6
Vintage clothing 61.1
Fast food 59.3
Toy 57.4
History 53.6
Visual arts 51.5

Microsoft
created on 2022-02-26

indoor 93.6
text 91.2
table 84.8
window 82.6
person 80.7
clothing 65.1
black and white 59.9
man 59.7
store 33.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Female, 92.8%
Sad 47.3%
Calm 31.4%
Confused 6.3%
Angry 5.3%
Disgusted 4.3%
Happy 2.6%
Surprised 1.6%
Fear 1.2%

AWS Rekognition

Age 18-24
Gender Male, 60.6%
Happy 65%
Calm 20.4%
Sad 11.2%
Confused 1.5%
Disgusted 0.7%
Surprised 0.5%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 23-33
Gender Male, 96.1%
Calm 96.1%
Surprised 1.2%
Happy 0.8%
Disgusted 0.7%
Confused 0.4%
Angry 0.4%
Sad 0.3%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.1%
Person 98.3%
Person 94.8%
Person 73.7%

Categories

Imagga

interior objects 78.4%
paintings art 18.6%
streetview architecture 2.5%

Text analysis

Amazon

18
ass
KODAK-SEEIA

Google

18
18