Human Generated Data

Title

Untitled (magician pulling rabbit out of hat, children in bed)
Date

c. 1949
People

Artist: Robert Burian, American active 1940s-1950s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19370

Human Generated Data

Title

Untitled (magician pulling rabbit out of hat, children in bed)

People

Artist: Robert Burian, American active 1940s-1950s

Date

c. 1949

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19370

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.4
Human 99.4
Person 99
Furniture 98.5
Person 98.4
Home Decor 97.2
Meal 95.1
Food 95.1
Interior Design 94.5
Indoors 94.5
Couch 92.5
Sunglasses 92.5
Accessories 92.5
Accessory 92.5
Dish 89.4
Restaurant 89.2
Table 88.1
Sitting 82.2
Dining Table 75.1
Chair 74.5
Bed 74.1
Face 73.4
Pottery 64
Room 62.8
Cafeteria 59.7
Blanket 57.4
Head 57.4
Cafe 57.3
Coffee Cup 56.9
Cup 56.9
Cushion 56.1
Clothing 55.3
Apparel 55.3

Clarifai
created on 2023-10-22

people 99.8
adult 98.2
man 97.9
group 97.5
group together 96.7
furniture 96.2
two 91.1
outfit 91
facial expression 90.6
leader 90.2
monochrome 89.8
room 88.8
recreation 88.7
wear 88.6
sit 85.2
administration 84.6
woman 84.1
indoors 82.8
sitting 82.6
music 81.3

Imagga
created on 2022-03-05

brass 64.2
sax 63.9
wind instrument 55.5
musical instrument 34.2
man 28.2
male 24.8
person 22.2
people 21.7
cornet 21.7
music 20.3
adult 20.1
musician 16.7
men 15.4
black 14.4
musical 14.3
play 12.9
player 12.8
bass 12.2
instrument 12.1
group 12.1
device 11.9
sport 11.5
performance 11.5
sound 11.3
performer 11
trombone 10.8
suit 10.8
guitar 10.7
businessman 10.6
jazz 9.8
business 9.7
concert 9.7
hands 9.5
playing 9.1
bugle 9
human 9
horn 8.4
dark 8.3
event 8.3
city 8.3
training 8.3
entertainment 8.3
outdoors 8.2
interior 7.9
lifestyle 7.9
uniform 7.9
saxophone 7.9
art 7.8
band 7.8
portrait 7.8
professional 7.7
room 7.7
modern 7.7
skill 7.7
expression 7.7
club 7.5
guy 7.5
leisure 7.5
holding 7.4
exercise 7.3
dress 7.2
handsome 7.1

Google
created on 2022-03-05

Black 89.6
Hat 87
Black-and-white 84.5
Style 83.9
Art 75.3
Suit 74.7
Monochrome 73.7
Monochrome photography 73.3
Personal protective equipment 71.6
Vintage clothing 70.7
Room 69.9
Fedora 67.6
Sitting 66.1
Stock photography 64.1
Visual arts 62.1
Illustration 59.4
Font 57.2
Eyewear 56.4
Photo caption 56.1
Military person 55.9

Microsoft
created on 2022-03-05

person 98.3
clothing 91.6
text 90.2
indoor 87.9
human face 86.3
man 76.5
table 58.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Female, 90.6%
Sad 90.3%
Calm 9.1%
Happy 0.2%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%
Surprised 0%

AWS Rekognition

Age 24-34
Gender Female, 94.4%
Happy 97.4%
Calm 2.5%
Disgusted 0%
Surprised 0%
Angry 0%
Confused 0%
Sad 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Sunglasses
Bed
Person 99.4%
Person 99%
Person 98.4%
Sunglasses 92.5%
Bed 74.1%

Captions

Microsoft
created on 2022-03-05

a man sitting on a bed 74.4%
a man sitting on a bed reading a book 47.2%
a man reading a book on a bed 47.1%

Text analysis

Amazon

KODAK-SVEL