Human Generated Data

Title

Untitled (family having tea party in front of fireplace)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17466

Human Generated Data

Title

Untitled (family having tea party in front of fireplace)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17466

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Dress 100
Clothing 100
Apparel 100
Person 99.5
Human 99.5
Female 99.5
Person 99.4
Person 99
Person 97.7
Blonde 97.6
Teen 97.6
Woman 97.6
Kid 97.6
Girl 97.6
Child 97.6
Face 97.5
Furniture 96.1
Baby 95.1
Home Decor 94.4
Indoors 93.3
Floor 90.9
Room 86.9
Costume 86.3
Portrait 78.8
Photography 78.8
Photo 78.8
Chair 77
People 74
Living Room 73.4
Man 71.8
Couch 71.4
Smile 70.8
Play 69.1
Door 65.4
Shorts 64.1
Table 60.9
Hat 59.2
Suit 58.9
Coat 58.9
Overcoat 58.9
Newborn 58.8
Flooring 58
Glasses 57.9
Accessories 57.9
Accessory 57.9
Skirt 57.4

Clarifai
created on 2023-10-29

people 99.9
monochrome 97.8
group 97.2
child 96.8
woman 96.1
adult 96
man 94.4
wear 90.7
group together 89.9
outfit 89.7
interaction 86.8
two 86.7
veil 86.6
wedding 85.8
girl 85.1
actress 85.1
several 83.3
actor 82.2
dancing 81.6
nostalgia 81.5

Imagga
created on 2022-02-26

person 48.3
teacher 41.2
people 34.6
man 32.9
businessman 28.2
male 27.7
adult 26.7
education 23.4
brass 23.3
business 22.5
professional 22.4
educator 21.4
blackboard 19.7
wind instrument 18.9
student 18.6
classroom 17.9
cornet 15.8
silhouette 15.7
men 15.5
school 15.3
symbol 14.8
room 14.7
teaching 14.6
class 14.5
office 14.5
vibrant 14
event 13.9
nighttime 13.7
audience 13.6
board 13.6
meeting 13.2
player 12.9
bright 12.9
musical instrument 12.8
human 12.7
cheering 12.7
stadium 12.6
team 12.5
happy 12.5
skill 12.5
crowd 12.5
patriotic 12.5
nation 12.3
group 12.1
lights 12
training 12
flag 11.9
icon 11.9
design 11.8
college 11.4
glowing 11.1
sport 10.7
hand 10.6
job 10.6
modern 10.5
success 10.5
portrait 10.3
executive 10.3
work 10.2
casual 10.2
competition 10.1
businesswoman 10
patient 9.9
athlete 9.9
chalkboard 9.8
serve 9.8
boss 9.6
muscular 9.5
women 9.5
shiny 9.5
drawing 9.5
corporate 9.4
presentation 9.3
indoor 9.1
suit 9
planner 9
backhand 8.9
versus 8.9
racket 8.8
shorts 8.8
home 8.8
tennis 8.8
court 8.8
championship 8.8
couple 8.7
boy 8.7
match 8.7
smiling 8.7
smile 8.5
youth 8.5
desk 8.5
communication 8.4
manager 8.4
holding 8.3
occupation 8.2
park 8.2
financial 8
expression 7.7
studying 7.7
diagram 7.7
university 7.6
finance 7.6
field 7.5
sign 7.5
study 7.5
teamwork 7.4
sick person 7.3
case 7.3
black 7.2
handsome 7.1
interior 7.1
happiness 7

Google
created on 2022-02-26

Black-and-white 85.3
Style 83.9
Art 76.3
Monochrome photography 73.8
Vintage clothing 71.9
Monochrome 71.9
Room 70.1
Event 67.8
Classic 65.8
Toddler 65.1
Visual arts 64
Stock photography 63.5
Fun 60.2
Photographic paper 57.1
Suit 56.1
Font 52.5
Still life photography 51.5
History 50.5
Sitting 50

Microsoft
created on 2022-02-26

text 94.4
clothing 87.3
person 85.8
woman 77.7
cartoon 71

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Male, 84.3%
Surprised 46.4%
Happy 39.7%
Calm 5.6%
Sad 2.4%
Fear 2.2%
Angry 1.7%
Confused 1.3%
Disgusted 0.8%

AWS Rekognition

Age 21-29
Gender Female, 92.4%
Calm 98.7%
Surprised 0.5%
Sad 0.5%
Angry 0.1%
Disgusted 0.1%
Happy 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 16-24
Gender Male, 96.5%
Calm 89.3%
Sad 6.8%
Confused 0.9%
Surprised 0.8%
Disgusted 0.8%
Fear 0.6%
Angry 0.5%
Happy 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.5%
Person 99.4%
Person 99%
Person 97.7%

Categories

Imagga

paintings art 99.9%

Captions

Microsoft
created on 2022-02-26

an old photo of a person 57.5%
old photo of a person 54.9%
an old photo of a person 48%

Text analysis

Amazon

9R
ae
KODVK-SVELA

Google

VT37A2 -NAGOX
VT37A2
-NAGOX