Human Generated Data

Title

Untitled (boy and girl with umbrella in wind)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16910

Human Generated Data

Title

Untitled (boy and girl with umbrella in wind)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 98.9
Human 98.9
Person 98.2
Clothing 96.7
Apparel 96.7
Art 88.2
Paper 83.8
Origami 77.2
Hat 71.3
Coat 70.4

Imagga
created on 2022-02-26

canopy 100
umbrella 100
shelter 85.9
parasol 57.7
protective covering 55.6
covering 28.5
color 13.9
person 13.6
adult 12.9
people 12.3
summer 11.6
outdoors 11.2
celebration 11.2
love 11.1
wedding 11
holiday 10.8
outdoor 10.7
light 10.7
bride 10.6
portrait 10.4
sky 10.2
colorful 10
happy 10
water 10
man 9.4
flower 9.2
dress 9
fun 9
vertical 8.7
model 8.6
male 8.5
rain 8.5
travel 8.5
pretty 8.4
leisure 8.3
decoration 8
face 7.8
season 7.8
gift 7.7
attractive 7.7
hand 7.6
elegance 7.6
fashion 7.5
ribbon 7.4
protection 7.3
weather 7.2
celebrate 7.2
black 7.2
paper 7.1
smile 7.1
women 7.1
day 7.1
happiness 7.1

Google
created on 2022-02-26

Microsoft
created on 2022-02-26

text 99.7
umbrella 76.9
water 69.6
black and white 69.2
posing 42.5
accessory 36.7

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Female, 53.1%
Calm 80.7%
Sad 16.5%
Confused 1%
Happy 0.6%
Angry 0.4%
Surprised 0.4%
Fear 0.2%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Feature analysis

Amazon

Person 98.9%
Hat 71.3%

Captions

Microsoft

a person holding an umbrella 59.2%
a person holding a large umbrella 51.6%
a person standing in front of an open umbrella 51.5%

Text analysis

Amazon

63
KODAKA--EITW

Google

MJI7--YT3RA°2
MJI7--YT3RA°2 - -XAGON 63
-
-XAGON
63