Human Generated Data

Title

Untitled

Date

c. 1973

People

Artist: Tim Carlson, American 1949 -

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Robert M. Sedgwick II Fund, P1974.12

Human Generated Data

Title

Untitled

People

Artist: Tim Carlson, American 1949 -

Date

c. 1973

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Robert M. Sedgwick II Fund, P1974.12

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Clothing 99.6
Apparel 99.6
Person 99.6
Human 99.6
Person 99.3
Person 98.9
Person 98.7
Hat 96.1
Meal 94.7
Food 94.7
Person 86.8
Sun Hat 75.9
Dish 75.2
Sitting 71.8
Face 63.4
People 61.1
Photography 57.3
Photo 57.3
Coat 56.2
Overcoat 56.2

Clarifai
created on 2023-10-15

people 100
group together 99
group 99
adult 98.6
man 98.6
monochrome 97.9
furniture 95.7
woman 95.6
chair 94.7
administration 94.1
leader 91.7
many 91.2
portrait 89.8
child 86.8
party 85.4
meeting 84.7
street 84.1
several 83.2
wedding 82.2
four 81.2

Imagga
created on 2021-12-14

kin 66.3
man 32.2
people 26.8
newspaper 26.2
couple 26.1
male 22.1
love 21.3
product 20.3
person 19
mother 17.1
sitting 16.3
creation 16.1
happy 15.7
attractive 14.7
businessman 14.1
happiness 14.1
adult 13.3
silhouette 13.2
home 12.8
family 12.4
business 12.1
room 11.7
smiling 11.6
black 11.4
lady 11.4
boy 11.3
men 11.2
portrait 11
lifestyle 10.8
romantic 10.7
together 10.5
sexy 10.4
women 10.3
two 10.2
suit 9.9
pretty 9.8
fun 9.7
couch 9.7
office 9.6
wife 9.5
passion 9.4
senior 9.4
youth 9.4
indoor 9.1
sunset 9
parent 8.8
relationship 8.4
relax 8.4
joy 8.3
fashion 8.3
bride 8.1
team 8.1
looking 8
night 8
holiday 7.9
smile 7.8
model 7.8
play 7.8
husband 7.7
married 7.7
chair 7.7
outdoor 7.6
tie 7.6
togetherness 7.5
dark 7.5
style 7.4
cheerful 7.3
alone 7.3
aged 7.2
dress 7.2
body 7.2
romance 7.1
summer 7.1
day 7.1

Google
created on 2021-12-14

Coat 85.9
Chair 83.4
Suit 82.2
Adaptation 79.3
Font 77.8
Art 73.6
Event 72.8
Classic 71.6
Vintage clothing 70.4
Tree 69
Recreation 67.7
Formal wear 66.2
Table 64.8
Room 64.4
Sitting 63
History 62.6
Photo caption 61.6
Sharing 61.3
Visual arts 59.5
Monochrome photography 58.6

Microsoft
created on 2021-12-14

person 96.4
gallery 95.3
clothing 95
man 86.5
text 81.3
black and white 80.5
room 80.2
woman 74.7
human face 71.5
picture frame 37.5
screenshot 15.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-50
Gender Female, 88.4%
Calm 94.5%
Sad 4.5%
Happy 0.3%
Angry 0.2%
Fear 0.2%
Confused 0.1%
Surprised 0.1%
Disgusted 0%

AWS Rekognition

Age 49-67
Gender Male, 99.3%
Calm 66.2%
Sad 24.5%
Angry 3.9%
Confused 2.4%
Disgusted 1.3%
Surprised 1.1%
Happy 0.3%
Fear 0.3%

AWS Rekognition

Age 49-67
Gender Male, 96.8%
Calm 95.9%
Sad 3%
Angry 0.7%
Happy 0.1%
Surprised 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 22-34
Gender Female, 95.6%
Sad 97.1%
Calm 2.7%
Fear 0.1%
Angry 0%
Confused 0%
Surprised 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 44-62
Gender Female, 69.9%
Calm 95.9%
Sad 1.5%
Happy 1%
Surprised 0.7%
Fear 0.3%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 23-37
Gender Male, 78%
Calm 97.2%
Sad 2.1%
Confused 0.3%
Angry 0.2%
Surprised 0.1%
Happy 0%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 59
Gender Male

Microsoft Cognitive Services

Age 43
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 96.1%

Categories

Imagga

paintings art 98.8%