Human Generated Data

Title

Untitled (men with marionette dolls on stage)

Date

1950, printed later

People

Artist: Francis J. Sullivan, American 1916 - 1996

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.383

Human Generated Data

Title

Untitled (men with marionette dolls on stage)

People

Artist: Francis J. Sullivan, American 1916 - 1996

Date

1950, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.383

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Chair 99.6
Furniture 99.6
Person 99.5
Human 99.5
Person 99.5
Chair 96.6
Person 96.2
Person 94.2
Person 93.9
Person 93.7
Person 90
Person 89.2
Person 88.7
Person 86.8
Art 86.5
Painting 86.5
Wood 83.3
Flooring 83
Sitting 80.9
Person 73.2
Floor 62.5
Leisure Activities 58.4

Clarifai
created on 2023-10-25

people 100
group 99.4
child 99.1
furniture 97.2
adult 97.1
princess 96.7
woman 96.3
seat 95
wear 94.3
group together 93.2
room 92.1
man 92
dress 91.8
chair 91.6
art 90.9
bench 89.4
recreation 88.4
many 88.3
veil 88.1
several 86.6

Imagga
created on 2022-01-08

marimba 54
percussion instrument 45.1
musical instrument 37.9
man 29.6
people 29.5
table 27.8
male 27.6
room 26.1
sitting 25.8
couple 25.2
kin 24.4
person 24.2
women 23.7
chair 22.8
classroom 22.4
indoors 22
home 20.7
interior 20.3
adult 20.2
lifestyle 18.8
together 18.4
smiling 18.1
men 18
happy 16.3
cheerful 15.4
restaurant 14.3
student 14.3
family 14.2
house 14.2
love 14.2
office 13.9
holding 13.2
happiness 12.5
talking 12.3
togetherness 12.3
enjoyment 12.2
senior 12.2
business 12.1
teacher 12.1
group 12.1
modern 11.9
education 11.2
friendship 11.2
two 11
metropolitan 11
communication 10.9
leisure activity 10.8
two people 10.7
old 10.4
mature 10.2
wine 10.2
drink 10
smile 10
20 24 years 9.8
casual clothing 9.8
school 9.7
businessman 9.7
portrait 9.7
class 9.6
drinking 9.6
dining 9.5
work 9.5
enjoying 9.5
color 9.5
desk 9.4
meeting 9.4
day 9.4
relationship 9.4
glass 9.3
waiter 9.2
indoor 9.1
children 9.1
laptop 9.1
worker 9
full length 8.7
professional 8.7
content 8.7
loving 8.6
friends 8.4
learning 8.4
side 8.4
life 8.4
mother 8.4
coffee 8.3
outdoors 8.2
team 8.1
kid 8
child 7.9
employee 7.9
standing 7.8
boy 7.8
students 7.8
scene 7.8
boyfriend 7.7
girlfriend 7.7
husband 7.6
meal 7.6
eating 7.6
bar 7.4
hall 7.2
suit 7.2
dinner 7.2
handsome 7.1
to 7.1

Google
created on 2022-01-08

Tree 84
Chair 83.4
Art 82.8
Adaptation 79.2
Painting 76.6
Plant 76.4
Vintage clothing 72.4
Room 71.9
Visual arts 69
Classic 67.2
Illustration 65.5
Rectangle 64.8
History 64.4
Wood 63.6
Stock photography 62.3
Antique 61.9
Monochrome 61.3
Drawing 60.2
Collection 58.7
Holy places 58

Microsoft
created on 2022-01-08

text 98
floor 94.4
furniture 91.6
person 82.8
table 79.8
clothing 70.3
black 69.5
chair 66.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 100%
Sad 85.4%
Calm 12.4%
Angry 0.9%
Confused 0.4%
Fear 0.4%
Happy 0.2%
Surprised 0.1%
Disgusted 0.1%

AWS Rekognition

Age 33-41
Gender Male, 100%
Calm 59.3%
Happy 10.8%
Angry 10.3%
Disgusted 8.1%
Confused 5.6%
Surprised 3.9%
Sad 1.1%
Fear 0.8%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Calm 67.7%
Angry 12.1%
Disgusted 8.3%
Sad 5.1%
Confused 4.8%
Surprised 0.8%
Fear 0.7%
Happy 0.4%

AWS Rekognition

Age 25-35
Gender Female, 99.5%
Surprised 58.9%
Happy 17.9%
Fear 11.4%
Angry 3.1%
Sad 2.7%
Calm 2.5%
Disgusted 2%
Confused 1.5%

AWS Rekognition

Age 19-27
Gender Male, 100%
Happy 100%
Surprised 0%
Angry 0%
Confused 0%
Fear 0%
Sad 0%
Calm 0%
Disgusted 0%

AWS Rekognition

Age 1-7
Gender Female, 80.9%
Surprised 73.9%
Calm 11.4%
Fear 10.4%
Confused 1.7%
Happy 1%
Sad 0.6%
Disgusted 0.6%
Angry 0.5%

AWS Rekognition

Age 50-58
Gender Female, 78.5%
Calm 64.1%
Happy 16.3%
Sad 10.8%
Surprised 3%
Disgusted 1.8%
Confused 1.6%
Angry 1.4%
Fear 1%

AWS Rekognition

Age 20-28
Gender Female, 99%
Fear 84.5%
Surprised 11.5%
Calm 1.5%
Happy 1.3%
Sad 0.4%
Angry 0.4%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 20-28
Gender Female, 55.4%
Calm 59%
Disgusted 11.8%
Fear 8.8%
Confused 7.9%
Sad 7.2%
Surprised 2.2%
Angry 1.7%
Happy 1.4%

AWS Rekognition

Age 18-24
Gender Female, 88.3%
Calm 75.7%
Fear 11.2%
Sad 4.5%
Surprised 3.7%
Confused 1.7%
Happy 1.2%
Angry 1.1%
Disgusted 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 99.6%
Person 99.5%
Painting 86.5%

Categories

Text analysis

Amazon

MUTUAL
GRANGE
FIRE
SHEPAR
BARTLETT
BEYOND
JOHN'S
HOMES
PILLSBURY
RICHARD
BEYOND THE
FOR HOMES
STORE
FOR
THE
FURNITURE STORE
FURNITURE
BILL'SDINER
H
4BertrandEpeabooul GRANGE MUTUAL FIRE JOHN'S COFFEE BILL'SDINER RICHARD H ADAMS BARTLETT SHEPAR
ADAMS
COFFEE
Koma
Sweething Koma Loaved
Sweething
Loaved
4BertrandEpeabooul

Google

anoased
www FOR HOMES PILLSBURVRertrandidleabobn GRANGE MUTUAL FIRE JOHNS BILISDINER RICHARD HADAKS BARTLETT SHEPAN BEYOND THE EURNITURE STORE COFFEE Swthin anoased
www
FOR
HOMES
PILLSBURVRertrandidleabobn
GRANGE
MUTUAL
FIRE
JOHNS
BILISDINER
RICHARD
HADAKS
BARTLETT
SHEPAN
BEYOND
THE
EURNITURE
STORE
COFFEE
Swthin