Human Generated Data

Title

Inserted photograph of Piene at "Regenbogen-Fest"
Date

1973
People

Artist: Otto Piene, German 1928 - 2014
Classification

Archival Material
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Elizabeth Goldring Piene, 2019.6.1.3
Copyright

© Otto Piene Estate

Human Generated Data

Title

Inserted photograph of Piene at "Regenbogen-Fest"

People

Artist: Otto Piene, German 1928 - 2014

Date

1973

Classification

Archival Material

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Elizabeth Goldring Piene, 2019.6.1.3

Copyright

© Otto Piene Estate

Machine Generated Data

Tags

Amazon
created on 2021-03-26

Person 99.7
Human 99.7
Person 98.8
Person 98.6
Person 92.6
Canvas 86
Poster 79.7
Advertisement 79.7
Art 78.7
Collage 77.5
Person 76.7
Face 68.9
Text 67.8
Clothing 67
Apparel 67
Drawing 63.7
Photography 60.9
Photo 60.9
Art Gallery 56.9
Portrait 56.7

Clarifai
created on 2021-03-26

people 97.4
man 94.8
portrait 93.8
painting 91.2
woman 90.3
adult 89.7
one 89
indoors 88.3
art 88
wear 87.9
two 86.8
retro 86
winter 85.7
family 85.4
nature 85
girl 85
no person 84.8
moment 83.8
picture frame 83.3
outdoors 82.5

Imagga
created on 2021-03-26

paper 37
blank 36
frame 36
notebook 34
binder 26.5
grunge 24.7
empty 22.3
old 22.3
page 20.4
texture 19.4
border 19
sheet 18.8
protective covering 18.2
vintage 18.2
book 18.1
card 18
space 17.8
album 17.5
message 17.3
retro 17.2
screen 16.9
monitor 16.2
business 15.8
note 15.6
scrapbook 15.5
design 15.2
covering 14.8
art 14.6
announcement 13.6
display 13.5
information 13.3
document 13
office 12.9
insulating material 12.6
memory 12.6
background 12.4
pattern 12.3
equipment 11.9
copy 11.5
congratulation 10.8
wall 10.7
reminder 10.7
liquid crystal display 10.6
antique 10.4
ancient 10.4
greeting 10.2
aged 10
element 9.9
backdrop 9.9
open 9.9
photograph 9.8
education 9.5
building material 9.4
write 9.4
cover 9.3
wallpaper 9.2
school 9
diary 8.8
graphic 8.8
text 8.7
torn 8.7
window 8.7
invitation 8.7
holiday 8.6
color 8.3
board 8.3
electronic equipment 8.3
sign 8.3
letter 8.3
style 8.2
object 8.1
journal 7.9
textured 7.9
scrap 7.9
black 7.8
pen 7.6
post 7.6
rusty 7.6
anniversary 7.5
ribbon 7.4
birthday 7.4
light 7.4
computer 7.2
paint 7.2
structure 7.2
interior 7.1
leaf 7

Google
created on 2021-03-26

Sleeve 87.2
Rectangle 84
Font 77
Art 71
Room 65.7
Bag 64.5
Brand 64.3
Visual arts 62.8
Pattern 59.9
Fashion design 59.3
Paper product 58
Book 57.8
Publication 56.6
Illustration 56.5
Arch 55.3
Monochrome photography 53.7
Wood 53
Notebook 51.8
Photographic paper 51.7
Graphic design 50.9

Microsoft
created on 2021-03-26

gallery 98.7
wall 98
room 97.5
indoor 94.3
text 92
scene 91.8
drawing 88.6
person 84
clothing 83
sketch 73.5
picture frame 72.8
white 62.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 47-65
Gender Male, 96.6%
Happy 55.8%
Calm 43.8%
Surprised 0.2%
Sad 0.1%
Confused 0.1%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 20-32
Gender Female, 72.5%
Confused 46.3%
Angry 28.2%
Disgusted 10.5%
Calm 10.3%
Happy 1.7%
Sad 1.3%
Fear 0.9%
Surprised 0.7%

AWS Rekognition

Age 47-65
Gender Male, 95.9%
Calm 94.8%
Sad 3.9%
Angry 0.4%
Confused 0.2%
Disgusted 0.2%
Surprised 0.2%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 20-32
Gender Female, 84.9%
Calm 97.7%
Sad 1%
Angry 0.4%
Surprised 0.4%
Happy 0.3%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 13-23
Gender Female, 82.4%
Calm 46.8%
Sad 39.7%
Happy 10.3%
Angry 2.2%
Fear 0.8%
Disgusted 0.1%
Confused 0.1%
Surprised 0.1%

AWS Rekognition

Age 19-31
Gender Male, 68.1%
Sad 84.1%
Calm 7.2%
Happy 4.1%
Fear 3.6%
Angry 0.5%
Confused 0.3%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 24-38
Gender Female, 57.7%
Sad 57.6%
Calm 31.3%
Happy 8.7%
Angry 0.8%
Confused 0.7%
Fear 0.3%
Disgusted 0.2%
Surprised 0.2%

Microsoft Cognitive Services

Age 58
Gender Male

Microsoft Cognitive Services

Age 55
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Categories

Imagga

interior objects 86.3%
food drinks 8.1%
paintings art 4.4%

Captions

Text analysis

Amazon

W